Re: [DFDL-WG] [DFDL]: First Release of DFDL4S Parser Library
Dear Michele Good to hear from you. Thank you for letting me know about the latest developments with S2G Data Viewer. I am sure the DFDL Working Group would be interested in a demo of S2G. What is your availability on Tuesdays at 4pm-5pm UK? Meantime do you have a document that you could send which summarises which features of the DFDL language you have used, and some example schemas? Please note that the DFDL 1.0 specification was re-published in October 2014, replacing and obsoleting the version from January 2011. Does S2G comply with the October 2014 version ( https://www.ogf.org/documents/GFD.207.pdf) ? Regards Steve Hanson Architect, IBM DFDL Co-Chair, OGF DFDL Working Group IBM SWG, Hursley, UK smh@uk.ibm.com tel:+44-1962-815848 From: Michele Zundo <michele.zundo@esa.int> To: Steve Hanson/UK/IBM@IBMGB Cc: Montserrat Piñol <mpinol@eopp.esa.int>, Maurizio De Bartolomei <Maurizio.De.Bartolomei@esa.int>, "Rui Mestre (DME)" <rui.mestre@deimos.com.pt> Date: 29/04/2015 17:38 Subject: [DFDL]: First Release of DFDL4S Parser Library Dear Steve, we talked some time ago when we presented the tool we developed at ESA to inspect satellite TM and which made use of DFDL description for the binary data and we have included a number of your comments at the time. Since then we have further evolved the tool (called S2G Data Viewer) and produced as well a standalone version of a Java library which performs the function of extracting data field from binary data based on a DFDL description. This library (called DFDL4S i.e. DFDL for Space) is now available to anybody interested. It implements only the subset of the Core capability that we need but I think it might be nevertheless interesting for the DFDL community. In future we plan to expand to write capability the same library so user can serialise their data as per DFDL description and generate realistically looking (simulated) satellite data. The application and the library are available for download at http:eop-cfi.esa.int If there is interest we could arrange a short demo of the app (using webex) or I couldd ask the developer to show the command line test of the DFDL4S library. We are very happy/willing to share results/code/etc. Best Regards PS we are currently thinking to build “transformation” that can ingest different type of descriptive representation and generate the corresponding DFDL schemas. ESA - European Space Agency Michele Zundo Head of Ground System Definition and Verification Office System Support Division Earth Observation Project Department Directorate of Earth Observation Programmes ESTEC Kepleerlaan 1, 2200AZ Noordwijk, Netherlands michele.zundo@esa.int | www.esa.int T. +31 71 565 3924 | F +31 71 565 3191 This message and any attachments are intended for the use of the addressee or addressees only. The unauthorised disclosure, use, dissemination or copying (either in whole or in part) of its content is not permitted. If you received this message in error, please notify the sender and delete it from your system. Emails can be altered and their integrity cannot be guaranteed by the sender. Please consider the environment before printing this email. Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
Dear Steve, my answers below.
On 06 May 2015, at 10:49 , Steve Hanson <smh@uk.ibm.com> wrote:
Dear Michele
Good to hear from you. Thank you for letting me know about the latest developments with S2G Data Viewer.
I am sure the DFDL Working Group would be interested in a demo of S2G. What is your availability on Tuesdays at 4pm-5pm UK?
I’m currently on mission abroad for the rst of the week, but Tue 12th May at 16:00 is (for now) a possibility as I should be back in office. Can we touch base to confirm this next Monday ? (by e-mail).
Meantime do you have a document that you could send which summarises which features of the DFDL language you have used, and some example schemas?
The application and the documentation are free download from our web site as mentioned below. (http://eop-cfi.esa.int/index.php/applications/s2g-data-viewer/download <http://eop-cfi.esa.int/index.php/applications/s2g-data-viewer/download>) free registration (no string attached) is required.
Please note that the DFDL 1.0 specification was re-published in October 2014, replacing and obsoleting the version from January 2011. Does S2G comply with the October 2014 version (https://www.ogf.org/documents/GFD.207.pdf <https://www.ogf.org/documents/GFD.207.pdf>) ?
do not know. We will have to check. In general I would suggest you define and update the document version number and not only the date to make clear that an update otherwise it always look like it is version 1.0...
Regards
Steve Hanson Architect, IBM DFDL <http://www.ibm.com/developerworks/library/se-dfdl/index.html> Co-Chair, OGF DFDL Working Group <http://www.ogf.org/dfdl/> IBM SWG, Hursley, UK smh@uk.ibm.com <mailto:smh@uk.ibm.com> tel:+44-1962-815848
From: Michele Zundo <michele.zundo@esa.int> To: Steve Hanson/UK/IBM@IBMGB Cc: Montserrat Piñol <mpinol@eopp.esa.int>, Maurizio De Bartolomei <Maurizio.De.Bartolomei@esa.int>, "Rui Mestre (DME)" <rui.mestre@deimos.com.pt> Date: 29/04/2015 17:38 Subject: [DFDL]: First Release of DFDL4S Parser Library
Dear Steve,
we talked some time ago when we presented the tool we developed at ESA to inspect satellite TM and which made use of DFDL description for the binary data and we have included a number of your comments at the time.
Since then we have further evolved the tool (called S2G Data Viewer) and produced as well a standalone version of a Java library which performs the function of extracting data field from binary data based on a DFDL description. This library (called DFDL4S i.e. DFDL for Space) is now available to anybody interested. It implements only the subset of the Core capability that we need but I think it might be nevertheless interesting for the DFDL community.
In future we plan to expand to write capability the same library so user can serialise their data as per DFDL description and generate realistically looking (simulated) satellite data.
The application and the library are available for download at http:eop-cfi.esa.int <http://eop-cfi.esa.int/>
If there is interest we could arrange a short demo of the app (using webex) or I couldd ask the developer to show the command line test of the DFDL4S library.
We are very happy/willing to share results/code/etc.
Best Regards
PS we are currently thinking to build “transformation” that can ingest different type of descriptive representation and generate the corresponding DFDL schemas.
ESA - European Space Agency Michele Zundo Head of Ground System Definition and Verification Office System Support Division Earth Observation Project Department Directorate of Earth Observation Programmes
ESTEC Kepleerlaan 1, 2200AZ Noordwijk, Netherlands michele.zundo@esa.int <mailto:michele.zundo@esa.int> | www.esa.int <file:///x-msg/::11:www.esa.int> T. +31 71 565 3924 | F +31 71 565 3191
This message and any attachments are intended for the use of the addressee or addressees only. The unauthorised disclosure, use, dissemination or copying (either in whole or in part) of its content is not permitted. If you received this message in error, please notify the sender and delete it from your system. Emails can be altered and their integrity cannot be guaranteed by the sender.
Please consider the environment before printing this email.
Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
----------------------------------------- Michele Zundo Head of Ground System Definition and Verification Office EOP-PEP European Space Agency, ESTEC e-mail: michele.zundo@esa.int This message and any attachments are intended for the use of the addressee or addressees only. The unauthorised disclosure, use, dissemination or copying (either in whole or in part) of its content is not permitted. If you received this message in error, please notify the sender and delete it from your system. Emails can be altered and their integrity cannot be guaranteed by the sender. Please consider the environment before printing this email.
Dear Michele my replies below Regards Steve Hanson Architect, IBM DFDL Co-Chair, OGF DFDL Working Group IBM SWG, Hursley, UK smh@uk.ibm.com tel:+44-1962-815848 From: Michele Zundo <michele.zundo@esa.int> To: Steve Hanson/UK/IBM@IBMGB Cc: Maurizio De Bartolomei <Maurizio.De.Bartolomei@esa.int>, Montserrat Piñol <mpinol@eopp.esa.int>, "Rui Mestre (DME)" <rui.mestre@deimos.com.pt>, DFDL-WG <dfdl-wg@ogf.org> Date: 06/05/2015 09:57 Subject: Re: [DFDL]: First Release of DFDL4S Parser Library Dear Steve, my answers below. On 06 May 2015, at 10:49 , Steve Hanson <smh@uk.ibm.com> wrote: Dear Michele Good to hear from you. Thank you for letting me know about the latest developments with S2G Data Viewer. I am sure the DFDL Working Group would be interested in a demo of S2G. What is your availability on Tuesdays at 4pm-5pm UK? I’m currently on mission abroad for the rst of the week, but Tue 12th May at 16:00 is (for now) a possibility as I should be back in office. Can we touch base to confirm this next Monday ? (by e-mail). SMH: Yes that would be fine. Meantime do you have a document that you could send which summarises which features of the DFDL language you have used, and some example schemas? The application and the documentation are free download from our web site as mentioned below. ( http://eop-cfi.esa.int/index.php/applications/s2g-data-viewer/download) free registration (no string attached) is required. Please note that the DFDL 1.0 specification was re-published in October 2014, replacing and obsoleting the version from January 2011. Does S2G comply with the October 2014 version ( https://www.ogf.org/documents/GFD.207.pdf) ? do not know. We will have to check. In general I would suggest you define and update the document version number and not only the date to make clear that an update otherwise it always look like it is version 1.0... SMH: There is only DFDL version 1.0 and it is October 2014. The original specification from January 2011 needed many corrections and additions to the document. However only a few small additions to the actual syntax of the language. The WG decided to keep the version at 1.0 so that all existing schemas (mainly written by IBM customers) remained compliant. If a new release appears in the future then that will be 1.1 or 2.0. I would guess that the S2G subset is compliant with October 2014 but worth checking. Regards Steve Hanson Architect, IBM DFDL Co-Chair, OGF DFDL Working Group IBM SWG, Hursley, UK smh@uk.ibm.com tel:+44-1962-815848 From: Michele Zundo <michele.zundo@esa.int> To: Steve Hanson/UK/IBM@IBMGB Cc: Montserrat Piñol <mpinol@eopp.esa.int>, Maurizio De Bartolomei <Maurizio.De.Bartolomei@esa.int>, "Rui Mestre (DME)" < rui.mestre@deimos.com.pt> Date: 29/04/2015 17:38 Subject: [DFDL]: First Release of DFDL4S Parser Library Dear Steve, we talked some time ago when we presented the tool we developed at ESA to inspect satellite TM and which made use of DFDL description for the binary data and we have included a number of your comments at the time. Since then we have further evolved the tool (called S2G Data Viewer) and produced as well a standalone version of a Java library which performs the function of extracting data field from binary data based on a DFDL description. This library (called DFDL4S i.e. DFDL for Space) is now available to anybody interested. It implements only the subset of the Core capability that we need but I think it might be nevertheless interesting for the DFDL community. In future we plan to expand to write capability the same library so user can serialise their data as per DFDL description and generate realistically looking (simulated) satellite data. The application and the library are available for download at http:eop-cfi.esa.int If there is interest we could arrange a short demo of the app (using webex) or I couldd ask the developer to show the command line test of the DFDL4S library. We are very happy/willing to share results/code/etc. Best Regards PS we are currently thinking to build “transformation” that can ingest different type of descriptive representation and generate the corresponding DFDL schemas. ESA - European Space Agency Michele Zundo Head of Ground System Definition and Verification Office System Support Division Earth Observation Project Department Directorate of Earth Observation Programmes ESTEC Kepleerlaan 1, 2200AZ Noordwijk, Netherlands michele.zundo@esa.int | www.esa.int T. +31 71 565 3924 | F +31 71 565 3191 This message and any attachments are intended for the use of the addressee or addressees only. The unauthorised disclosure, use, dissemination or copying (either in whole or in part) of its content is not permitted. If you received this message in error, please notify the sender and delete it from your system. Emails can be altered and their integrity cannot be guaranteed by the sender. Please consider the environment before printing this email. Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU ----------------------------------------- Michele Zundo Head of Ground System Definition and Verification Office EOP-PEP European Space Agency, ESTEC e-mail: michele.zundo@esa.int This message and any attachments are intended for the use of the addressee or addressees only. The unauthorised disclosure, use, dissemination or copying (either in whole or in part) of its content is not permitted. If you received this message in error, please notify the sender and delete it from your system. Emails can be altered and their integrity cannot be guaranteed by the sender. Please consider the environment before printing this email. Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
On this specific point I understand that the version of the DFDL language is still 1.0, what I was referring to is having an incremental versioning of the document (not on the version of the language) and not relying only on the date for configuration management. Anyway do not worry now is clear. Regards Sent from my iPhone
On 06 May 2015, at 11:23, Steve Hanson <smh@uk.ibm.com> wrote:
Please note that the DFDL 1.0 specification was re-published in October 2014, replacing and obsoleting the version from January 2011. Does S2G comply with the October 2014 version (https://www.ogf.org/documents/GFD.207.pdf) ?
SMH: There is only DFDL version 1.0 and it is October 2014. The original specification from January 2011 needed many corrections and additions to the document. However only a few small additions to the actual syntax of the language. The WG decided to keep the version at 1.0 so that all existing schemas (mainly written by IBM customers) remained compliant. If a new release appears in the future then that will be 1.1 or 2.0. I would guess that the S2G subset is compliant with October 2014 but worth checking.
This message and any attachments are intended for the use of the addressee or addressees only. The unauthorised disclosure, use, dissemination or copying (either in whole or in part) of its content is not permitted. If you received this message in error, please notify the sender and delete it from your system. Emails can be altered and their integrity cannot be guaranteed by the sender. Please consider the environment before printing this email.
Yes it's not just done on the date. It's actually a new OGF document called GFD.207, the old document was called GFD.174. Regards Steve Hanson Architect, IBM DFDL Co-Chair, OGF DFDL Working Group IBM SWG, Hursley, UK smh@uk.ibm.com tel:+44-1962-815848 From: Michele Zundo <michele.zundo@esa.int> To: Steve Hanson/UK/IBM@IBMGB Cc: DFDL-WG <dfdl-wg@ogf.org>, Maurizio De Bartolomei <Maurizio.De.Bartolomei@esa.int>, Montserrat Piñol <mpinol@eopp.esa.int>, "Rui Mestre (DME)" <rui.mestre@deimos.com.pt> Date: 06/05/2015 11:44 Subject: Re: [DFDL]: First Release of DFDL4S Parser Library On this specific point I understand that the version of the DFDL language is still 1.0, what I was referring to is having an incremental versioning of the document (not on the version of the language) and not relying only on the date for configuration management. Anyway do not worry now is clear. Regards Sent from my iPhone On 06 May 2015, at 11:23, Steve Hanson <smh@uk.ibm.com> wrote: Please note that the DFDL 1.0 specification was re-published in October 2014, replacing and obsoleting the version from January 2011. Does S2G comply with the October 2014 version ( https://www.ogf.org/documents/GFD.207.pdf) ? SMH: There is only DFDL version 1.0 and it is October 2014. The original specification from January 2011 needed many corrections and additions to the document. However only a few small additions to the actual syntax of the language. The WG decided to keep the version at 1.0 so that all existing schemas (mainly written by IBM customers) remained compliant. If a new release appears in the future then that will be 1.1 or 2.0. I would guess that the S2G subset is compliant with October 2014 but worth checking. This message and any attachments are intended for the use of the addressee or addressees only. The unauthorised disclosure, use, dissemination or copying (either in whole or in part) of its content is not permitted. If you received this message in error, please notify the sender and delete it from your system. Emails can be altered and their integrity cannot be guaranteed by the sender. Please consider the environment before printing this email. Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
Ok. Point taken. Shall use the doc number from now on. MZ Sent from my iPhone
On 06 May 2015, at 13:56, Steve Hanson <smh@uk.ibm.com> wrote:
Yes it's not just done on the date. It's actually a new OGF document called GFD.207, the old document was called GFD.174.
Regards
Steve Hanson Architect, IBM DFDL Co-Chair, OGF DFDL Working Group IBM SWG, Hursley, UK smh@uk.ibm.com tel:+44-1962-815848
From: Michele Zundo <michele.zundo@esa.int> To: Steve Hanson/UK/IBM@IBMGB Cc: DFDL-WG <dfdl-wg@ogf.org>, Maurizio De Bartolomei <Maurizio.De.Bartolomei@esa.int>, Montserrat Piñol <mpinol@eopp.esa.int>, "Rui Mestre (DME)" <rui.mestre@deimos.com.pt> Date: 06/05/2015 11:44 Subject: Re: [DFDL]: First Release of DFDL4S Parser Library
On this specific point I understand that the version of the DFDL language is still 1.0, what I was referring to is having an incremental versioning of the document (not on the version of the language) and not relying only on the date for configuration management. Anyway do not worry now is clear.
Regards
Sent from my iPhone
On 06 May 2015, at 11:23, Steve Hanson <smh@uk.ibm.com> wrote:
Please note that the DFDL 1.0 specification was re-published in October 2014, replacing and obsoleting the version from January 2011. Does S2G comply with the October 2014 version (https://www.ogf.org/documents/GFD.207.pdf) ?
SMH: There is only DFDL version 1.0 and it is October 2014. The original specification from January 2011 needed many corrections and additions to the document. However only a few small additions to the actual syntax of the language. The WG decided to keep the version at 1.0 so that all existing schemas (mainly written by IBM customers) remained compliant. If a new release appears in the future then that will be 1.1 or 2.0. I would guess that the S2G subset is compliant with October 2014 but worth checking.
This message and any attachments are intended for the use of the addressee or addressees only. The unauthorised disclosure, use, dissemination or copying (either in whole or in part) of its content is not permitted. If you received this message in error, please notify the sender and delete it from your system. Emails can be altered and their integrity cannot be guaranteed by the sender.
Please consider the environment before printing this email.
Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
This message and any attachments are intended for the use of the addressee or addressees only. The unauthorised disclosure, use, dissemination or copying (either in whole or in part) of its content is not permitted. If you received this message in error, please notify the sender and delete it from your system. Emails can be altered and their integrity cannot be guaranteed by the sender. Please consider the environment before printing this email.
Just a minor point about version numbering. In OGF, we leave protocol version numbering to the groups, but in general we encourage version numbers to remain the same if the changes are errata only, to change as point releases if the changes are backwards compatible but significant — usually with a new document number and optionally with additional explanatory documents — and to change to a new whole number upon non-backwards-compatible releases. The OGF document development process is linked from the documents page on the web site, http://ogf.org/documents/ and is formally documented in GFD 152: http://ogf.org/documents/GFD.152.pdf Alan On May 6, 2015, at 8:54 AM, Michele Zundo <michele.zundo@esa.int<mailto:michele.zundo@esa.int>> wrote: Ok. Point taken. Shall use the doc number from now on. MZ Sent from my iPhone On 06 May 2015, at 13:56, Steve Hanson <smh@uk.ibm.com<mailto:smh@uk.ibm.com>> wrote: Yes it's not just done on the date. It's actually a new OGF document called GFD.207, the old document was called GFD.174. Regards Steve Hanson Architect, IBM DFDL<http://www.ibm.com/developerworks/library/se-dfdl/index.html> Co-Chair, OGF DFDL Working Group<http://www.ogf.org/dfdl/> IBM SWG, Hursley, UK smh@uk.ibm.com<mailto:smh@uk.ibm.com> tel:+44-1962-815848 From: Michele Zundo <michele.zundo@esa.int<mailto:michele.zundo@esa.int>> To: Steve Hanson/UK/IBM@IBMGB Cc: DFDL-WG <dfdl-wg@ogf.org<mailto:dfdl-wg@ogf.org>>, Maurizio De Bartolomei <Maurizio.De.Bartolomei@esa.int<mailto:Maurizio.De.Bartolomei@esa.int>>, Montserrat Piñol <mpinol@eopp.esa.int<mailto:mpinol@eopp.esa.int>>, "Rui Mestre (DME)" <rui.mestre@deimos.com.pt<mailto:rui.mestre@deimos.com.pt>> Date: 06/05/2015 11:44 Subject: Re: [DFDL]: First Release of DFDL4S Parser Library ________________________________ On this specific point I understand that the version of the DFDL language is still 1.0, what I was referring to is having an incremental versioning of the document (not on the version of the language) and not relying only on the date for configuration management. Anyway do not worry now is clear. Regards Sent from my iPhone On 06 May 2015, at 11:23, Steve Hanson <smh@uk.ibm.com<mailto:smh@uk.ibm.com>> wrote: Please note that the DFDL 1.0 specification was re-published in October 2014, replacing and obsoleting the version from January 2011. Does S2G comply with the October 2014 version (https://www.ogf.org/documents/GFD.207.pdf) ? SMH: There is only DFDL version 1.0 and it is October 2014. The original specification from January 2011 needed many corrections and additions to the document. However only a few small additions to the actual syntax of the language. The WG decided to keep the version at 1.0 so that all existing schemas (mainly written by IBM customers) remained compliant. If a new release appears in the future then that will be 1.1 or 2.0. I would guess that the S2G subset is compliant with October 2014 but worth checking. This message and any attachments are intended for the use of the addressee or addressees only. The unauthorised disclosure, use, dissemination or copying (either in whole or in part) of its content is not permitted. If you received this message in error, please notify the sender and delete it from your system. Emails can be altered and their integrity cannot be guaranteed by the sender. Please consider the environment before printing this email. Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU This message and any attachments are intended for the use of the addressee or addressees only. The unauthorised disclosure, use, dissemination or copying (either in whole or in part) of its content is not permitted. If you received this message in error, please notify the sender and delete it from your system. Emails can be altered and their integrity cannot be guaranteed by the sender. Please consider the environment before printing this email. -- dfdl-wg mailing list dfdl-wg@ogf.org<mailto:dfdl-wg@ogf.org> https://www.ogf.org/mailman/listinfo/dfdl-wg
participants (3)
-
Michele Zundo -
Sill, Alan -
Steve Hanson