- dfdl-wg - lists.ogf.org

Cancelled: OGF DFDL WG Call
by Steve Hanson 01 Jul '13

01 Jul '13

Holidays in USA

1 0

regex free-spacing mode
by Mike Beckerle 27 Jun '13

27 Jun '13

I wrote this complicated regex today and it works in Daffodil. Question is this. Is the (?x) which turns on regex free-spacing mode, officially supported in DFDL? You can see from below that it is VERY desirable that it works..... <xs:simpleType name="frontMatterType"> <xs:annotation> <xs:appinfo source="http://www.ogf.org/dfdl/"> <dfdl:simpleType lengthKind="pattern" terminator="%FF;"> <dfdl:property name="lengthPattern"><![CDATA[(?x) # regex free spacing mode # # match the front matter of the document # .{1,8192}? # up to 8K of front matter content # # front matter ends at the first message description page # (?= # lookahead (followed by but not including...) \f # a formfeed character (?> \s | \x08 ){1,100}? # whitespace or backspace (x08) MESSAGE\ DESCRIPTION\r # this literal text \s{1,100}? # up to 100 whitespaces -{19}\r # exactly 19 hyphens and a CR ) # end lookahead ]]></dfdl:property> </dfdl:simpleType> </xs:appinfo> </xs:annotation> <xs:restriction base="xs:string" /> </xs:simpleType> -- Mike Beckerle | OGF DFDL Workgroup Co-Chair | Tresys Technology | www.tresys.com

2 2

dfdl:outputValueCalc referencing itself
by Steve Hanson 26 Jun '13

26 Jun '13

The spec currently says that the expression in dfdl:outputValueCalc must not refer to itself. I am wondering if that is too restrictive. For example, what if I wanted to apply a simple transformation to the data before it is serialized, example: <xs:element name="f1" type="xs:string" dfdl:outputValueCalc="{fn:upper-case(.)}" /> Regards Steve Hanson Architect, IBM Data Format Description Language (DFDL) Co-Chair, OGF DFDL Working Group IBM SWG, Hursley, UK smh(a)uk.ibm.com tel:+44-1962-815848 Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

3 2

XSD for DFDL?
by Garriss Jr., James P. 26 Jun '13

26 Jun '13

DFDL is XML. Is there an XML Schema (XSD) for DFDL? TIA.

2 1

small spec issues
by Mike Beckerle 25 Jun '13

25 Jun '13

Jonathan Cranford reported two issues in the spec: 1. Pages 11-12 of the draft include a sample DFDL schema for a comma-separated format. I asked you about this example before, and you told me that there's no ambiguity between having a comma (,) as a separator and as the textStandardGroupingSeparator. I think I understand why (there's a question on that below). Regardless of why, though, I think that having the same character as both the separator and textStandardGroupingSeparator is a potential point of confusion, especially this early in the document. So I recommend reworking the example to avoid the appearance of ambiguity and avoid relying on the technical workings of textNumberPattern, which hasn’t been introduced yet. Is this example not ambiguous because none of the textNumberPattern attributes contain a grouping separator? If so, couldn’t the textStandardGroupingSeparator attribute just be removed from the example so that others don't get confused on it like I did? 2. Minor editorial comment - Page 15 – I think 3rd bullet should end in period instead of a comma, for consistency with other bullets.

2 1

Can I concatenate a variable?
by Garriss Jr., James P. 25 Jun '13

25 Jun '13

Suppose I define a variable like this: <dfdl:defineVariable name="boundary" defaultValue="some_boundary" type="xsd:string"/> Can I later concatenate it with other values? For example, can I concatenate it as part of a pattern? <xsd:element name="Preamble" type="xsd:string" dfdl:lengthKind="pattern" dfdl:lengthPattern="(.+?)(?=--{$some_boundary})"/> Can I concatenate it as part of a separator? <xsd:sequence dfdl:separator="--{$some_boundary}" dfdl:separatorSuppressionPolicy="anyEmpty" dfdl:terminator="--%CR;%LF;"> TIA!

3 5

Can I specify a terminator for the last element in a sequence?
by Garriss Jr., James P. 24 Jun '13

24 Jun '13

I have a repeating element, one that can occur 1 to unbounded times. The elements are separated by a prefixed separator, like so: <xsd:sequence dfdl:separator="some-separator-here" dfdl:separatorSuppressionPolicy="anyEmpty" dfdl:separatorPosition="prefix"> <xsd:element name="BodyPart" dfdl:lengthKind="delimited" minOccurs="1" maxOccurs="unbounded" type="xsd:string" dfdl:occursCountKind="implicit"/> </xsd:sequence> The last element (and only the last element) has a terminator. Is there a way in DFDL to specify that final terminator?

2 1

Re: [DFDL-WG] Can DFDL parse TLV data?
by Andre Merzky 21 Jun '13

21 Jun '13

Hello, I forwarded your mail to the DFDL-WG mailing list -- they will be able to give a qualified answer. Best regards, Andre. On Fri, Jun 21, 2013 at 10:59 AM, Xin TZ Zhang <xzhangbj(a)cn.ibm.com> wrote: > Dear OFGer: > Can DFDL parse TLV data? TLV(tag-length-value) data is binary, and variable > length... > (sorry for my poor English) > Best Regards zx. -- Nothing is really difficult.

2 1

How to specify type/subtype combos?
by Garriss Jr., James P. 21 Jun '13

21 Jun '13

Content types come in pairs. So while the type can be "text" and the subtype can be "pdf", the complete content type cannot be "text/pdf". It can, however, be "text/html" or "application/pdf". So in my DFDL it's not sufficient to specify enumerated lists for types and subtypes (as I have done below), I must also specify which types are allowed to go with which subtypes. How would I do that, given this complexType? TIA! <xsd:complexType name="MimeTypeType"> <xsd:sequence dfdl:separator="/"> <xsd:element name="Type" dfdl:initiator=""> <xsd:annotation> <xsd:appinfo source="http://www.ogf.org/dfdl/dfdl-1.0/"> <dfdl:assert test="{ dfdl:checkConstraints(.) }" message="The type must match one of the values on the enumerated list."/> </xsd:appinfo> </xsd:annotation> <xsd:simpleType> <xsd:restriction base="xsd:string"> <xsd:pattern value="([a|A][p|P][p|P][l|L][i|I][c|C][a|A][t|T][i|I][o|O][n|N])| ([m|M][u|U][l|L][t|T][i|I][p|P][a|A][r|R][t|T])| ([m|M][e|E][s|S][s|S][a|A][g|G][e|E])| ([t|T][e|E][x|X][t|T])" /> </xsd:restriction> </xsd:simpleType> </xsd:element> <xsd:element name="Subtype" dfdl:terminator=""> <xsd:annotation> <xsd:appinfo source="http://www.ogf.org/dfdl/dfdl-1.0/"> <dfdl:assert test="{ dfdl:checkConstraints(.) }" message="The subtype must match one of the values on the enumerated list."/> </xsd:appinfo> </xsd:annotation> <xsd:simpleType> <xsd:restriction base="xsd:string"> <xsd:pattern value="([p|P][d|D][f|F])| ([a|A][l|L][t|T][e|E][r|R][n|N][a|A][t|T][i|I][v|V][e|E])| ([m|M][i|I][x|X][e|E][d|D])| ([r|R][f|F][c|C]822)| ([p|P][l|L][a|A][i|I][n|N])| ([h|H][t|T][m|M][l|L])" /> </xsd:restriction> </xsd:simpleType> </xsd:element> </xsd:sequence> </xsd:complexType>

4 4

How to ignore case and validate an element with an enumerated list
by Garriss Jr., James P. 20 Jun '13

20 Jun '13

Mike came up with a solid solution to the problem I posted previously. While not quite as elegant as adding the "dfdl:ignoreElementCase=yes" property that I would prefer, it's good enough. Thanks, Mike! Here's the relevant parts: <xsd:complexType name="MimeTypeType"> <xsd:sequence> <xsd:sequence dfdl:hiddenGroupRef="MixedCaseMimeTypeGroup"/>  <xsd:element name="Type" dfdl:inputValueCalc="{ fn:lower-case(../MixedCaseType) }"> <xsd:annotation> <xsd:appinfo source="http://www.ogf.org/dfdl/dfdl-1.0/"> <dfdl:assert test="{ dfdl:checkConstraints(.) }" message="The type must match one of the values on the enumerated list."/> </xsd:appinfo> </xsd:annotation> <xsd:simpleType> <xsd:restriction base="xsd:string"> <xsd:enumeration value="application"/> <xsd:enumeration value="multipart"/> <xsd:enumeration value="message"/> <xsd:enumeration value="text"/> </xsd:restriction> </xsd:simpleType> </xsd:element> <xsd:element name="Subtype" dfdl:inputValueCalc="{ fn:lower-case(../MixedCaseSubtype) }"> <xsd:annotation> <xsd:appinfo source="http://www.ogf.org/dfdl/dfdl-1.0/"> <dfdl:assert test="{ dfdl:checkConstraints(.) }" message="The subtype must match one of the values on the enumerated list."/> </xsd:appinfo> </xsd:annotation> <xsd:simpleType> <xsd:restriction base="xsd:string"> <xsd:enumeration value="pdf"/> <xsd:enumeration value="ms-tnef"/>  <xsd:enumeration value="alternative"/> <xsd:enumeration value="mixed"/> <xsd:enumeration value="rfc822"/> <xsd:enumeration value="plain"/> <xsd:enumeration value="html"/> </xsd:restriction> </xsd:simpleType> </xsd:element> </xsd:sequence> </xsd:complexType>  <xsd:group name="MixedCaseMimeTypeGroup"> <xsd:sequence dfdl:separator="/"> <xsd:element name="MixedCaseType" type="xsd:string"/> <xsd:element name="MixedCaseSubtype" type="xsd:string"/> </xsd:sequence> </xsd:group>

2 1