December 2022 - dfdl-wg - lists.ogf.org

Latest OGF DFDL WG Call Minutes
by Steve Hanson 21 Jun '23

21 Jun '23

Please find minutes from the latest call at https://github.com/OpenGridForum/DFDL/wiki/DFDL-Workgroup-News. Regards Steve Hanson IBM Integration, Hursley, UK Architect, IBM DFDL Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com<mailto:smh@uk.ibm.com> tel:+44-7717-378890 Note: I work Tuesday to Friday Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6 3AU

3 12

Agenda for DFDL WG Call
by Steve Hanson 08 Jun '23

08 Jun '23

Please find agenda for today's DFDL WG call on GitHub at https://github.com/OpenGridForum/DFDL/blob/master/calls/2022/2022-10-06_DFD…. Note change of format of agenda & minutes to GitHub markdown file. Mike can't make the call on 20th October so next call after today's is 3rd November. Regards Steve Hanson IBM Integration, Hursley, UK Architect, IBM DFDL Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com tel:+44-7717-378890 Note: I work Tuesday to Friday Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6 3AU

2 12

Clarify/Simplify - description of textNumberPattern with V, P
by Mike Beckerle 05 Jan '23

05 Jan '23

I am implementing dfdl:textNumberPattern characters V and E for Apache Daffodil. The DFDL Spec says (Section 13.6.1.1) It is a Schema Definition Error if any symbols other than "0", "1" through "9" or # are used in the vpinteger region of the pattern. Note that the vpitneger region of the pattern excludes the leading and/or trailing sign indicator characters which are the prefix and suffix. The prefix and suffix can contain any character except the special characters of the pattern language. Later in the section the spec has a number of detailed statements that are subsumed by the above I believe. - A pattern with a V symbol must not have @ or * symbols. - A pattern with P symbols must not have @ or E or * symbols. So those latter 2 statements could be omitted since @ and * are "special characters" so aren't allowed in the prefix/suffix, and per above stipulation can't be in the vpinteger region either. Can't we simplify and just say a pattern with V or P cannot have any special characters other than 0-9 and # ? Mike Beckerle Apache Daffodil PMC | daffodil.apache.org OGF DFDL Workgroup Co-Chair | www.ogf.org/ogf/doku.php/standards/dfdl/dfdl Owl Cyber Defense | www.owlcyberdefense.com

2 2

interesting format: RINEX
by Mike Beckerle 04 Jan '23

04 Jan '23

I ran into an interesting format today called RINEX that is problematic for DFDL v1.0: http://acc.igs.org/misc/rinex304.pdf This format has a multi-line header with various kinds of header lines which are 80 characters, but characters 1 to 60 are data, and 61 to 80 are the "label", and you need the label in order to know how to parse the data of each header line. This either requires deep (and slow) speculation, or some sort of look ahead feature. E.g., See page 69 of that spec document for an example. The headers appear not only at the start of the file, but at the start of each data block. We have run into the need for short, fixed-distance look ahead before in other formats. In the case of RINEX the lookahead is exactly 60 characters. In other formats it is also a very short distance, but one which is tricky to figure out as the spec doesn't say exactly how big the region to be looked past is. One would have to figure it out from the data format spec. It's always a constant of course. Mike Beckerle Apache Daffodil PMC | daffodil.apache.org OGF DFDL Workgroup Co-Chair | www.ogf.org/ogf/doku.php/standards/dfdl/dfdl Owl Cyber Defense | www.owlcyberdefense.com

2 2

Next OGF DFDL WG call - cancelled
by Steve Hanson 15 Dec '22

15 Dec '22

Mike is unable to make the next call on Oct 20th so cancelling. Next call is Nov 3rd. Regards Steve Hanson IBM Integration, Hursley, UK Architect, IBM DFDL Co-Chair, OGF DFDL Working Group smh(a)uk.ibm.com<mailto:smh@uk.ibm.com> tel:+44-7717-378890 Note: I work Tuesday to Friday Unless otherwise stated above: IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6 3AU

1 1

Example announcement: "Joint Development Foundation recognized as an ISO/IEC JTC 1 PAS submitter and submits OpenChain for international review - Linux Foundation"
by Sill, Alan 03 Dec '22

03 Dec '22

DFDL folks, FYI, the following announcement from the Linux Foundation might be useful as an example of how we can go forward with announcements for DFDL as a submission to ISO/IEC JTC1 once you are ready to proceed. I suggest rather than waiting for a new version, you consider submitting DFDL 1.0 as an ISO standard and follow up with any updates as future submissions. Other approaches are possible, of course. Let us know if you need any assistance or would like to have further discussions on this process. Alan Alan Sill, Ph.D Managing Director, High Performance Computing Center Adjunct Professor of Physics and Astronomy Texas Tech University Drane 159, MS 4-1167 <http://www.hpcc.ttu.edu/>http://www.hpcc.ttu.edu<http://www.hpcc.ttu.edu/> Co-Director, NSF Center for Cloud and Autonomic Computing https://nsfcac.org<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fnsfcac.or…> President, Open Grid Forum https://www.ogf.org e-mail: Alan.Sill(a)ttu.edu<mailto:Alan.Sill@ttu.edu> ph. 806-834-5940 ——— Joint Development Foundation recognized as an ISO/IEC JTC 1 PAS submitter and submits OpenChain for international review THE LINUX FOUNDATION | 12 MAY 2020 […] This week, we are proud to announce that the Joint Development Foundation<http://www.jointdevelopment.org/> (JDF), which became part of the Linux Foundation family in 2019, has been accepted as an ISO/IEC JTC 1 PAS (“Publicly Available Specification”) Submitter. The OpenChain Specification is the first specification submitted for JTC 1 review<https://www.linuxfoundation.org/press-release/2020/05/joint-development-fou…> and recognition as an international standard. The JDF was formed to simplify the process of creating new technical specification collaboration efforts. Standards and specifications are vitally important for the creation or advancement of new technologies, ensuring that the resulting products are well defined, provide predictable performance and that different implementations can interoperate with one another. […] Announcement link<https://www.linuxfoundation.org/blog/blog/joint-development-foundation-reco…>

1 0