RFC 4823

FTP Transport for Secure Peer-to-Peer Business Data Interchange over the Internet

๐Ÿ“… published April 2007, from ietf

RFC 4823: FTP Transport for Secure Peer-to-Peer Business Data Interchange over the Internet ๐ŸŽ€

Network Working Group โœจ Authors: T. Harding and R. Scott, both from Axway ๐Ÿ’– Category: Informational ๐Ÿงš Date: April 2007 ๐ŸŒธ Obsoletes / Updates: None listed in the header, so this RFC doesn't obsolete or update any other RFC ๐Ÿฆ‹


Status of This Memo ๐ŸŒˆ

okay so this memo is information for the Internet community. It is NOT an Internet standard of any kind, and distribution is unlimited ๐Ÿ’…

Copyright (C) The IETF Trust (2007).

Abstract ๐Ÿฆ‹

this Applicability Statement (AS) is basically the how-to for swapping structured business data safely over FTP ๐Ÿ“ฆ The data can be XML, binary, Electronic Data Interchange (EDI - ANSI X12 or UN/EDIFACT), or other business-to-business data, as long as it can be packaged with standard MIME content types. Authentication and data confidentiality come from Cryptographic Message Syntax (S/MIME) security body parts ๐Ÿ” And the authenticated acknowledgements are multipart/signed replies to the original message โœจ

Table of Contents ๐Ÿ“š

   1. Introduction ....................................................4
   2. Overview ........................................................4
      2.1. Overall Operations .........................................4
      2.2. Purpose of a Security Guideline for MIME EDI ...............5
      2.3. Definitions ................................................5
           2.3.1. Terms ...............................................5
           2.3.2. The Secure Transmission Loop ........................6
           2.3.3. Definition of Receipts ..............................7
      2.4. Operational Assumptions and Options ........................8
           2.4.1. EDI/EC Process Assumptions ..........................8
           2.4.2. Process Options .....................................8
                  2.4.2.1. Security Options ...........................8
                  2.4.2.2. Compression Options .......................10
   3. Referenced RFCs and Their Contribution .........................10
      3.1. RFC 959: File Transfer Protocol [3] .......................10
      3.2. RFC 2228: FTP Security Extensions [4] .....................10
      3.3. RFC 1847: MIME Security Multiparts [7] ....................10
      3.4. RFC 3462: Multipart/Report [12] ...........................11
      3.5. RFC 1767: EDI Content [2] .................................11
      3.6. RFCs 2045, 2046, and 2049: MIME [1] .......................11
      3.7. RFC 3798: Message Disposition Notification [6] ............11
      3.8. RFC 3852: CMS [9] and RFC 3851: S/MIME Version 3.1
           Message Specification [10] ................................11
      3.9. RFC 3850: S/MIME Version 3.1 Certificate Handling [11] ....11
      3.10. RFC 3274: Compressed Data Content Type for
            Cryptographic Message Syntax (CMS) [17] ..................11
      3.11. RFC 3023: XML Media Types [16] ...........................12
   4. Structure of an AS3 Message ....................................12
      4.1. Introduction ..............................................12
      4.2. Structure of an Internet EDI MIME Message .................12
   5. AS3-Specific Headers ...........................................13
      5.1. AS3-From and AS3-To Headers ...............................13
      5.2. AS3-Version Header ........................................14
   6. FTP Considerations .............................................15
      6.1. FTP Security Requirements .................................15
      6.2. Large File Transfers ......................................15
      6.3. MIME Considerations for FTP ...............................15
           6.3.1. Required/Optional Headers ..........................15
           6.3.2. Content-Transfer-Encoding ..........................16
           6.3.3. Epilogue Must Be Empty .............................16
           6.3.4. Message-Id and Original-Message-Id .................16
   7. Structure and Processing of an MDN Message .....................17
      7.1. Introduction ..............................................17
      7.2. Message Disposition Notifications (MDN) ...................19
      7.3. Requesting a Signed Receipt ...............................19
           7.3.1. Signed Receipt Considerations ......................22

      7.4. MDN Format and Value ......................................23
           7.4.1. AS3-MDN General Formats ............................23
           7.4.2. AS3-MDN Construction ...............................24
           7.4.3. AS3-MDN Fields .....................................25
           7.4.4. Additional AS3-MDN Programming Notes ...............26
      7.5. Disposition Mode, Type, and Modifier ......................29
           7.5.1. Disposition Mode Overview ..........................29
           7.5.2. Successful Processing Status Indication ............29
           7.5.3. Unsuccessful Processed Content .....................29
           7.5.4. Unsuccessful Non-Content Processing ................30
           7.5.5. Processing Warnings ................................31
   8. Public Key Certificate Handling ................................32
   9. Security Considerations ........................................33
   10. References ....................................................34
      10.1. Normative References .....................................34
      10.2. Informative References ...................................36
   Appendix A. Message Examples ......................................37
      A.1. Signed Message Requesting a Signed Receipt ................37
      A.2. MDN for Message A.1 Above .................................37

1. Introduction ๐Ÿ“

so, previous work on Internet EDI focused on specifying MIME content types for EDI data [2], and then extended that to support secure EC/EDI transport over SMTP [5] ๐Ÿ’Œ This document levels that up by using RFC 1767 as a base and specifying a full set of data security features over FTP: data privacy, data integrity, authenticity, non-repudiation of origin, and non-repudiation of receipt ๐Ÿ”ฅ It also builds on contemporary RFCs and tries to "re-invent" as little as possible, which is very respectful of everyone's time ๐Ÿซถ Even though the focus is EDI data, any other data type describable in a MIME format is also supported ๐ŸŒˆ

Internet MIME-based EDI can be accomplished by using and complying with the following documents:

  • RFC 959: File Transfer Protocol
  • RFC 2228: FTP Security Extensions
  • RFC 1767: EDI Content Type
  • RFC 3023: XML Media Types
  • RFC 1847: Security Multiparts for MIME
  • RFC 3462: Multipart/Report
  • RFCs 2045 to 2049: MIME
  • RFC 3798: Message Disposition Notification
  • RFCs 3850, 3851, and 3852: S/MIME v3.1 Specifications
  • RFC 3274: Compressed Data Content for Cryptographic Message Syntax
  • RFC 4217: Securing FTP with TLS
  • "Compressed Data for EDIINT" by T. Harding

Our intent here is to define clearly and precisely how these are used together, and what is required by user agents to be compliant with this document ๐ŸŽ€

The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in RFC 2119 [19] ๐Ÿ“

2. Overview ๐ŸŒธ

2.1. Overall Operations โœจ

an FTP upload operation is how you send appropriately packaged EDI, XML, or other business data ๐Ÿ“ค The receiving application polls the FTP server for inbound messages, unpackages and handles the message data, then generates a reply for the originator. That reply holds a message disposition acknowledgement inside a multipart/report, and it can be signed or unsigned ๐Ÿ’… This request/reply back-and-forth gives you secure, reliable, and authenticated transport for EDI or other business data over FTP, which is honestly so iconic ๐Ÿ‘‘ The security protocols and structures also support auditable records of these transmissions ๐Ÿงพ

2.2. Purpose of a Security Guideline for MIME EDI ๐Ÿ’–

the whole point of these specs is to make sure B2B Electronic Commerce user agents can interoperate while invoking some or all of the commonly expected security features ๐Ÿค This document is also NOT limited to strict EDI use. It applies to any electronic commerce application where business data needs to be exchanged over the Internet in a secure manner ๐Ÿฆ‹

2.3. Definitions ๐Ÿงš

2.3.1. Terms ๐Ÿ“–

Here are the terms, in a table so you can see them all at once:

   AS3                  Applicability Statement 3.  This is the third
                        applicability statement produced by the IETF
                        EDIINT working group.

   EDI                  Electronic Data Interchange

   EC                   Business-to-Business Electronic Commerce

   B2B                  Business to Business

   Receipt              The functional message that is sent from a
                        receiver to a sender to acknowledge receipt of
                        an EDI/EC interchange.

   Signed Receipt       A receipt containing a digital signature.

   Message Disposition  The Internet messaging format used to convey a
   Notification (MDN)   receipt.  This term is used interchangeably with
                        receipt.  An MDN is a receipt.

   Non-repudiation of NRR is a "legal event" that occurs when the
   receipt (NRR)        original sender of an EDI/EC interchange has
                        verified the signed receipt coming back from the
                        receiver.  NRR IS NOT a functional or a
                        technical message.

   S/MIME               A format and protocol for adding Cryptographic
                        signature and/or encryption services to Internet
                        MIME messages.

                        NOTE: While the S/MIME specification describes
                              more than one format for a signed message,
                              all signed messages or receipts used with
                              AS3 MUST utilize the multipart/signed
                              format.

   SHA-1                A secure, one-way hash algorithm used in
                        conjunction with digital signature.  SHA-1 is
                        the recommend algorithm for AS3.

   MD5                  A secure, one-way hash algorithm used in
                        conjunction with digital signature.  This
                        algorithm is acceptable but not recommended due
                        to its short key length and known weaknesses.

   MIC                  The message integrity check (MIC) is a
                        representation of the message digest, which
                        results from the application of the selected
                        hash algorithm to the content to be signed.  Of
                        particular interest is the digital signature,
                        which includes an encrypted copy of the digest.
                        Additionally, an MDN containing a Received-
                        content-MIC header will also contain (as that
                        header's value) a base-64-encoded representation
                        of the digest.

   User Agent (UA)      The application that handles and processes the
                        AS3 request.

   STL                  Secure Transmission Loop, described in the next
                        section.

2.3.2. The Secure Transmission Loop ๐Ÿ”

okay so this doc is all about the formats and protocols for swapping EDI/EC content that has security services applied to it, using the File Transmission Protocol (FTP) as the transport ๐Ÿ’Œ

The "Secure Transmission Loop" (STL) is basically two steps:

a) The originator sends a signed and encrypted document with a request for a signed receipt.

b) The recipient decrypts the document, verifies the signature, and returns a signed receipt to the sender.

so here's what actually happens during the STL ๐Ÿ‘€

  • The organization sending EDI/EC data signs and encrypts the data using S/MIME. On top of that, the message requests a signed receipt to be sent back to the sender ๐Ÿซถ
  • The receiving organization decrypts the message and verifies the signature, which gives them verified integrity of the data and authenticity of the sender โœจ
  • Then the receiving organization sends back the signed receipt the sender asked for, as a message disposition notification. This signed receipt contains the hash of the signature from the received message, so the sender knows the message was verified and/or decrypted properly ๐Ÿ’…

the above is giving full security coverage. If it's implemented, it satisfies all security requirements and provides non-repudiation of receipt for the exchange ๐Ÿ” trading partners will usually want to use the STL, but this specification does not require it. no pressure bestie ๐ŸŒธ

2.3.3. Definition of Receipts ๐Ÿงพ

the word "receipt" (or "signed receipt") is used for both the activity and the message that acknowledges delivery of an EDI/EC interchange. "receipt" is used when the acknowledgment is for an interchange that results in a receipt that is not signed. "signed receipt" is used when the acknowledgment is for an interchange that results in a receipt that is signed. another term you'll see a lot is non-repudiation of receipt. NRR is a legal event that only happens once the original sender of an interchange has verified the signed receipt that came back from the recipient ๐Ÿง and note that NRR is not possible without signatures, so no sig, no NRR, periodt ๐Ÿ’€

for more info on formatting and processing receipts in AS3, go check Section 7 ๐Ÿ“–

2.4. Operational Assumptions and Options ๐ŸŽ€

2.4.1. EDI/EC Process Assumptions ๐Ÿงฉ

  • Encrypted object is an EDI/EC Interchange.

this spec assumes that a typical EDI/EC interchange is the lowest-level object that security services get applied to.

specifically, for EDI ANSI X12, the entire document (including the ISA and IEA segments) is the atom that security gets applied to. for EDIFACT, the matching definition includes the UNA/UNB and UNZ segments. so in other words, EDI/EC interchanges (envelope segments included) stay intact and unreadable during secure transport ๐Ÿ”’

  • EDI envelope headers are encrypted.

to keep things consistent with the above, EDI envelope headers are not visible in the MIME package. to make routing from existing commercial EDI networks (called Value Added Networks or VANs) onto the Internet easier, some work might be needed later to define ways to pull out certain envelope elements so they're visible. but that's out of scope for this specification ๐Ÿ™ˆ

  • X12.58 and UN/EDIFACT security considerations

the most common EDI standards bodies, ANSI X12 and EDIFACT, have their own internal security provisions. X12.58 is the security mechanism for ANSI X12, and AUTACK provides security for EDIFACT. this specification does not dictate whether you use these security standards or not. they're both fully compatible with this specification, though possibly redundant ๐Ÿฅฑ

2.4.2. Process Options โš™๏ธ

2.4.2.1. Security Options ๐Ÿ”

  • Encrypted or un-encrypted data

this spec allows EDI/EC message exchange where the EDI/EC data is either un-protected or protected by encryption ๐Ÿ™Œ

  • Signed or unsigned data

this spec allows EDI/EC message exchange with or without a digital signature on the original EDI transmission โœ๏ธ

  • Use of receipt or not

this spec allows EDI/EC message transmission with or without a request for receipt notification. BUT, if a signed receipt notification is requested, a MIC value is REQUIRED as part of the returned receipt, unless an error condition stops a valid digest from being computed. (for example, that would happen if an encrypted message couldn't be decrypted.) in those cases, an unsigned receipt (MDN) SHOULD be returned with the correct "disposition modifier" error value ๐Ÿšจ

  • Security formatting

this spec relies on the guidelines in RFCs 3852 [9] and 3851 [10]. the first describes the Cryptographic Message Syntax (CMS), and the second has the S/MIME Version 3.1 Message Specification, which describes a MIME container for CMS objects. whenever S/MIME shows up in this document, it means Version 3.1 as described there ๐ŸŽ

  • Hash function, message digest choices

when a signature is used, the SHA-1 hash algorithm is RECOMMENDED for all outgoing messages. however, both MD5 and SHA-1 MUST be supported for incoming messages ๐Ÿงช

  • Permutation summary

okay so there are twelve security permutations possible in any trading relationship. let's count them ๐Ÿ”ข

  1. Sender sends un-encrypted data, does not request a receipt.
  2. Sender sends un-encrypted data, requests an unsigned receipt. The receiver sends back the unsigned receipt.
  3. Sender sends un-encrypted data, requests a signed receipt. The receiver sends back the signed receipt.
  4. Sender sends encrypted data, does not request a receipt.
  5. Sender sends encrypted data, requests an unsigned receipt. The receiver sends back the unsigned receipt.
  6. Sender sends encrypted data, requests a signed receipt. The receiver sends back the signed receipt.
  7. Sender sends signed data, does not request a receipt.
  8. Sender sends signed data, requests an unsigned receipt. Receiver sends back the unsigned receipt.
  9. Sender sends signed data, requests a signed receipt. Receiver sends back the signed receipt.
  10. Sender sends encrypted and signed data, does not request a receipt.
  11. Sender sends encrypted and signed data, requests an unsigned receipt. Receiver sends back the unsigned receipt.
  12. Sender sends encrypted and signed data, requests a signed receipt. Receiver sends back the signed receipt. this is the Secure Transmission Loop from above, the main character of the whole list ๐Ÿ‘‘

2.4.2.2. Compression Options ๐Ÿ—œ๏ธ

AS3 supports compressing transmitted data directly through RFC 3274. implementation details live in that RFC and in Harding's document, "Compressed Data for EDIINT" ๐Ÿ“ฆ

3. Referenced RFCs and Their Contribution ๐Ÿ“š

3.1. RFC 959: File Transfer Protocol [3]

RFC 959 specifies how data gets transferred using the File Transfer Protocol (FTP) ๐Ÿ“ค

3.2. RFC 2228: FTP Security Extensions [4]

this RFC describes a framework for providing security services to FTP ๐Ÿ›ก๏ธ

3.3. RFC 1847: MIME Security Multiparts [7]

this doc defines security multiparts for MIME: multipart/encrypted and multipart/signed ๐Ÿ’œ

3.4. RFC 3462: Multipart/Report [12]

RFC 3462 defines the use of the multipart/report content type, and RFC 3798 builds on it to define the Message Disposition Notification ๐Ÿ“จ

3.5. RFC 1767: EDI Content [2]

this RFC defines the use of content type "application" for ANSI X12 (application/EDI-X12), EDIFACT (application/EDIFACT), and mutually defined EDI (application/EDI-Consent) ๐ŸŒท

3.6. RFCs 2045, 2046, and 2049: MIME [1]

these are the basic MIME standards that all the other MIME-related RFCs build on, this one included. the key stuff they bring is definitions of "content type", "sub-type", and "multipart", plus encoding guidelines that make 7-bit US-ASCII the canonical character set for Internet messaging ๐ŸŒˆ

3.7. RFC 3798: Message Disposition Notification [6]

this Internet RFC defines how a Message Disposition Notification (MDN) is requested, plus its format and syntax. the MDN is the vehicle this specification uses to provide both signed and unsigned receipts ๐Ÿงพ

3.8. RFC 3852: CMS [9] and RFC 3851: S/MIME Version 3.1 Message Specification [10]

this spec describes how MIME carries Cryptographic Message Syntax (CMS) objects ๐ŸŽ

3.9. RFC 3850: S/MIME Version 3.1 Certificate Handling [11]

RFC 3850 describes certificate handling in the context of CMS and S/MIME ๐Ÿชช

3.10. RFC 3274: Compressed Data Content Type for Cryptographic Message Syntax (CMS) [17]

this spec gives a mechanism for wrapping compressed data inside a CMS object ๐ŸŽˆ

3.11. RFC 3023: XML Media Types [16]

this RFC defines the use of content type "application" for XML. note that while conforming implementations SHOULD support the expanded syntax RFC 3023 introduces for the "+xml" suffix, no support for external parsed entity types is anticipated (since it adds a ton of complexity to signature processing) ๐Ÿฅน

4. Structure of an AS3 Message ๐Ÿ—๏ธ

4.1. Introduction ๐ŸŒŸ

the basic structure of AS3 messages is MIME-encapsulated data with the usual MIME headers plus a few extra AS3-specific outer headers. the structures below are described hierarchically, based on which RFCs got applied to build each one. for implementation details, go straight to the referenced RFCs ๐Ÿ“–

any extra restrictions this AS puts on top of that are called out in the sections that follow ๐Ÿง 

4.2. Structure of an Internet EDI MIME Message ๐Ÿ’Œ

No encryption, no signature

-RFC822/2045
  -RFC1767/RFC2376 (application/EDIxxxx or /xml)

No encryption, signature

-RFC822/2045
  -RFC1847 (multipart/signed)
    -RFC1767/RFC2376 (application/EDIxxxx or /xml)
    -RFC3851 (application/pkcs7-signature)

Encryption, no signature

-RFC822/2045
  -RFC3851 (application/pkcs7-mime)
    -RFC1767/RFC2376  (application/EDIxxxx or /xml)(encrypted)

Encryption, signature

-RFC822/2045
  -RFC3851 (application/pkcs7-mime)
    -RFC1847 (multipart/signed)(encrypted)
      -RFC1767/RFC2376  (application/EDIxxxx or /xml)(encrypted)
      -RFC3851 (application/pkcs7-signature)(encrypted)

MDN, no signature

-RFC822/2045
  -RFC3798 (message/disposition-notification)

MDN, signature

-RFC822/2045
  -RFC1847 (multipart/signed)
    -RFC3798 (message/disposition-notification)
    -RFC3851 (application/pkcs7-signature)

ok so while all MIME content types SHOULD be supported, the following MIME content types MUST be supported ๐Ÿซก

Content-Type: multipart/signed
Content-Type: multipart/report
Content-type: message/disposition-notification
Content-Type: application/PKCS7-signature
Content-Type: application/PKCS7-mime
Content-Type: application/EDI-X12
Content-Type: application/EDIFACT
Content-Type: application/edi-consent
Content-Type: application/XML

5. AS3-Specific Headers โœจ

5.1. AS3-From and AS3-To Headers โœจ

okay so the AS3-From and AS3-To headers exist so the sender and the recipient of an EC document can figure out who's who ๐Ÿ’– bestie, they look like this:

AS3-From: < AS3-name >
AS3-To:   < AS3-name >

These headers hold text values, and the ABNF [22] below spells out what counts as valid ๐ŸŽ€ they name the sender or receiver of a data exchange. A value can be company specific (like a Data Universal Numbering System (DUNS) number) ๐Ÿข, or it can be any string both trading partners agree on to identify each other ๐Ÿซถ

AS3-text = "!" /           ; printable ASCII characters
           %d35-91 /       ; except double-quote (%d34)
           %d93-126        ; or backslash (%d92)

AS3-qtext = AS3-text / SP  ; allow space only in quoted text

AS3-quoted-pair = "\" DQUOTE /  ; \" or
                  "\" "\"       ; \\

AS3-quoted-name = DQUOTE 1*128( AS3-qtext /
                  AS3-quoted-pair) DQUOTE

AS3-atomic-name = 1*128AS3-text

AS3-name = AS3-atomic-name / AS3-quoted-name

Note: SP and DQUOTE are defined in [ABNF]RFC 4234.

The AS3-From value and the AS3-To value MUST each be an AS3-name made of 1 to 128 printable ASCII characters ๐Ÿ”ฅ the header MUST NOT be folded, and the values are case-sensitive, so capitalisation matters, no cap ๐Ÿ™ˆ

The AS3-quoted-name SHOULD only be used when the AS3-name doesn't conform to AS3-atomic-name ๐Ÿ’…

The AS3-To and AS3-From header fields MUST be present in all AS3 messages and AS3 MDNs ๐Ÿ‘‘

Implementations that map things like EDI identifiers/qualifiers onto AS3 identifiers may choose to limit the AS3-To/AS3-From text values to a subset of the full set above, but they may not extend that set ๐Ÿงš

If the AS3-From, the AS3-To, or the pairing of the two header values is found to be invalid or unknown to the receiving system, the receiving system MAY respond with an unsigned MDN explaining the error, IF the sending system asked for an MDN. It is not required to send one in that situation ๐Ÿ™ˆ๐Ÿ’€

5.2. AS3-Version Header ๐ŸŒธ

The AS3-Version header is only required if the value of the header is not "1.0" ๐Ÿฆ‹ its whole job is letting systems check which version of this spec the sender used to package the document, since the spec might evolve over time. A user agent MUST NOT reject a message just because the version header is missing ๐Ÿซถ

AS3-Version: 1*DIGIT . 1*DIGIT

A version header value of "1.1" means the implementation can support EDIINT data compression [20] โœจ and a user agent MUST NOT send compressed messages to trading partners who don't use a version header of "1.1" or greater ๐Ÿ™…โ€โ™€๏ธ

6. FTP Considerations ๐Ÿงš

6.1. FTP Security Requirements ๐Ÿ”

FTP has been seen as an insecure protocol for a long time, mostly because it does cleartext authentication [3] ๐Ÿ˜ญ this gets addressed by RFC 2228 [4], and using one of the security mechanisms described there is strongly encouraged ๐Ÿ’œ Specifically, conforming AS3 implementations SHALL employ FTP client/servers that support the AUTH command described in [4]. Any authentication mechanism based on [4] MAY be used, but AUTH TLS (as described in [18]) MUST be supported ๐ŸŽ€ (Note that [18] relies on TLS Version 1.0 [13], not Version 1.1 [23].)

6.2. Large File Transfers ๐Ÿšš

Large files get handled correctly by the TCP layer, so no panic ๐Ÿ™Œ the compression mechanism referenced in Section 2.4.2.2 efficiently cuts transmission requirements for lots of data types (both XML and traditional EDI data, lowkey iconic) ๐Ÿ“ some FTP implementations support compression too โœจ

6.3. MIME Considerations for FTP ๐Ÿ’Œ

6.3.1. Required/Optional Headers ๐Ÿ“

An AS3 message MUST contain these outer headers:

AS3-To
AS3-From
Date
Message-ID
Content-Type

An AS3 message OPTIONALLY MAY contain these outer headers:

Subject
AS3-Version (assumed to be 1.0 if not present)
Content-Length

An AS3 message requesting a receipt MUST contain a Disposition-Notification-To header and MAY contain a Disposition-Notification-Options header (if the receipt is to be signed) ๐Ÿงพ

Additional headers MAY be present but are ignored ๐Ÿ™ˆ

6.3.2. Content-Transfer-Encoding ๐ŸŽ€

FTP defines several data structures and character encodings through the STRU[cture] and TYPE commands ๐Ÿงฉ AS3 requires the file-structure (default) and the image type. The Content-Transfer-Encoding header SHOULD NOT be used; if it's present, it SHOULD have a value of binary or 8-bit ๐Ÿซง leaving the header out, or using alternate values like "base64" or "quoted-printable", MUST NOT result in transaction failure, so chill ๐Ÿฅน content transfer encoding of MIME parts inside the AS3 message is constrained in the same way ๐Ÿ’…

6.3.3. Epilogue Must Be Empty ๐Ÿšซ

A MIME message containing an epilogue [1] SHALL NOT be used ๐Ÿ™…โ€โ™€๏ธ

6.3.4. Message-Id and Original-Message-Id ๐Ÿ†”

Message-Id and Original-Message-Id are formatted the way Section 3.6.4 of RFC 2822 [15] defines: "<" id-left "@" id-right ">". The Message-Id can be a maximum of 998 characters ๐Ÿ“ Message-Id SHOULD be globally unique, and id-right should be something unique to the sending host environment (like a host name) ๐ŸŒˆ when you send a message, always include the angle brackets, because angle brackets are not part of the Message-Id value ๐Ÿ’–

NOTE: When creating the Original-Message-Id header in an MDN, always use the exact syntax contained in the original message: do not strip or add "angle brackets". ๐Ÿ™ˆ

7. Structure and Processing of an MDN Message ๐Ÿ’Œ

7.1. Introduction ๐Ÿฆ‹

Okay so, to support non-repudiation of receipt, a signed receipt is supposed to be implemented ๐Ÿ” it's based on digitally signing a message disposition notification, and the receiving trading partner's UA is the one that does it. The MDN from RFC 3798 gets digitally signed by the receiving trading partner as part of a multipart/signed MIME message ๐Ÿ’œ

The following support for signed receipts is REQUIRED:

  1. The ability to create a multipart/report, where the report-type = disposition-notification.
  2. The ability to calculate a message integrity check (MIC) on the received message. The calculated MIC value gets returned to the sender inside the signed receipt ๐Ÿซถ
  3. The ability to create a multipart/signed content with the message disposition notification as the first body part, and the signature as the second body part.
  4. The ability to return the signed receipt to the sending trading partner ๐Ÿš€

The signed receipt is used to tell a sending trading partner who asked for it that:

  1. The receiving trading partner acknowledges receipt of the sent EC Interchange โœ…
  2. If the sent message was signed, the receiving trading partner has authenticated the sender of the EC Interchange ๐Ÿ”
  3. If the sent message was signed, the receiving trading partner has verified the integrity of the sent EC Interchange ๐Ÿงก

Regardless of whether the EDI/EC Interchange was sent in S/MIME format, the receiving trading partner's UA MUST provide the following basic processing ๐ŸŽ€

  1. If the sent EDI/EC Interchange is encrypted, the encrypted symmetric key, and the initialization vector (if applicable), get decrypted using the receiver's private key ๐Ÿ”‘
  2. The decrypted symmetric encryption key is then used to decrypt the EDI/EC Interchange.
  3. The receiving trading partner authenticates signatures in a message using the sender's public key. The authentication algorithm does the following:
    • a) The message integrity check (MIC or Message Digest) is decrypted using the sender's public key.
    • b) A MIC on the signed contents (the MIME header and encoded EDI object, as per RFC 1767) in the message received is calculated using the same one-way hash function that the sending trading partner used.
    • c) The MIC extracted from the message that was sent and the MIC calculated using the same one-way hash function that the sending trading partner used are compared for equality ๐Ÿ”
  4. The receiving trading partner formats the MDN and sets the calculated MIC into the "Received-content-MIC" extension field ๐Ÿ“จ
  5. The receiving trading partner creates a multipart/signed MIME message according to RFC 1847 ๐Ÿ’…
  6. The MDN is the first part of the multipart/signed message, and the digital signature is created over this MDN, including its MIME headers โœ๏ธ
  7. The second part of the multipart/signed message contains the digital signature. The "protocol" option specified in the second part of the multipart/signed is as follows: S/MIME: protocol = "application/pkcs7-signature" ๐ŸŒŸ
  8. The signature information is formatted according to S/MIME specifications. The EC Interchange and the RFC 1767 MIME EDI content header can actually be part of a multipart MIME content type. When the EDI Interchange is part of a multipart MIME content type, the MIC MUST be calculated across the entire multipart content, including the MIME headers ๐Ÿงฉ

The signed MDN, when the sender of the EDI Interchange receives it, can be used by the sender:

  1. As an acknowledgment that the EDI Interchange was sent, and then was delivered and acknowledged by the receiving trading partner. The receiver does this by returning the original-message-id of the sent message in the MDN portion of the signed receipt ๐Ÿ“ฌ
  2. As an acknowledgment that the integrity of the EDI Interchange was verified by the receiving trading partner. The receiver does this by returning the calculated MIC of the received EC Interchange (and 1767 MIME headers) in the "Received-content-MIC" field of the signed MDN ๐Ÿซง
  3. As an acknowledgment that the receiving trading partner has authenticated the sender of the EDI Interchange ๐Ÿฅฐ
  4. As a non-repudiation of receipt when the signed MDN is successfully verified by the sender with the receiving trading partner's public key, and the returned MIC value inside the MDN is the same as the digest of the original message ๐Ÿ”๐Ÿ’…

7.2. Message Disposition Notifications (MDN) ๐Ÿ“ฎ

The AS3-MDNs come back on a separate FTP TCP/IP connection, and each one is a response to an AS3 message ๐Ÿฆ‹

Here's how the AS3-MDN delivery goes down ๐Ÿ‘€

       AS3-MDN
      [S] ----( connect )----> [R]   [FTP Server]
      [S] ----( send )-------> [R]   [AS3-Message]
      [S] ----( disconnect )-> [R]   [FTP Server]

      [S] <---( connect )----- [R]   [FTP Server]
      [S] <---( send )-------- [R]   [AS3-MDN]]
      [S] <---( disconnect )-- [R]   [FTP Server]
Note: Refer to Section 7.4.4 for additional programming notes. ๐Ÿง โœจ

7.3. Requesting a Signed Receipt โœจ

Okay bestie, so MDNs get requested by following RFC 3798 ๐ŸŽ€. To ask the receiving user agent for a message disposition notification, you pop this header into the message you're sending ๐Ÿ’Œ:

MDN-request-header = "Disposition-notification-to" ":" ftpurl

This syntax is kinda a leftover from when MDNs were used over SMTP ๐Ÿ™ˆ. This spec is adjusting things from SMTP to FTP and keeping as much of the [5] functionality as it can, so the ftpurl must be present ๐Ÿ’….

The ftpurl field is specified as an RFC 1738 <URL:"ftp://" login [ "/" fpath [ ";type=" ftptype ]]>. It MUST be present, but it may be ignored if the ftpurl points to an unknown location. If it does point somewhere unknown, it is RECOMMENDED that the mdn is returned back to a known ftpurl for the sender of the received message ๐Ÿงš.

For requesting MDN-based receipts, the originator supplies the required extension headers that precede the message body ๐ŸŒธ.

Here's how the header "tags" work:

  • A Disposition-notification-to header is added to say that a message disposition notification is requested. This header is specified in [6].
  • A Message-ID header is added to support message reconciliation, so an Original-Message-Id value can be returned in the body part of the MDN.
  • Other headers, especially "Date", SHOULD be supplied. Their values are often mentioned in the human-readable section of an MDN, which helps everyone figure out which original message it's about ๐Ÿ”.
  • Disposition-notification-options identifies the characteristics of the message ๐Ÿฆ‹.

The following Disposition notification is in accordance with [6] โœจ.

      EXAMPLE:
        Disposition-notification-to:       // Requests the MDN
          ftp://host:port/inbox            // Location to return MDN
        Disposition-notification-options:  // The signing options for
                                              MDN
          signed-receipt-protocol=optional, pkcs7-signature;
          signed-receipt-micalg=optional, sha1, md5

Here's the syntax for Disposition-notification-options ๐Ÿ’–:

Disposition-notification-options =
      "Disposition-Notification-Options:"
       disposition-notification-parameters

disposition-notification-parameters =
           parameter *(";" parameter)

parameter = attribute "=" importance ", " value *("," value)

importance = "required" / "optional"

attribute = "signed-receipt-protocol" / "signed-receipt-micalg"

So the Disposition-notification-options string could look like this:

  signed-receipt-protocol=optional, <protocol symbol>;
  signed-receipt-micalg=optional, <micalg1>, <micalg2>,...;

The currently supported value for <protocol symbol> is pkcs7-signature, which is for the S/MIME detached signature format ๐Ÿ”.

The currently supported values for MIC algorithm <micalg> values are:

         Algorithm   Value
          Used
       --------   -------
          MD5         md5
          SHA-1       sha1

Receiving agents SHOULD be able to recover gracefully from a <micalg> parameter value that they do not recognize ๐Ÿซถ.

Now the semantics of the "signed-receipt-protocol" parameter, which is the main event ๐Ÿ‘‘:

  1. The "signed-receipt-protocol" parameter is used to request a signed receipt from the recipient trading partner. It also specifies the format in which the signed receipt should be returned to the requester.

The "signed-receipt-micalg" parameter is a list of MIC algorithms preferred by the requester for use in signing the returned receipt and calculating the micalg in the Received-content-MIC header.

The list of MIC algorithms should be honored by the recipient from left to right. Both the "signed-receipt-protocol" and the "signed-receipt-micalg" option parameters are REQUIRED when requesting a signed receipt ๐Ÿ“.

  1. The "importance" attribute of "Optional" is defined in RFC 3798, Section 2.2, and it means this:

Parameters with an importance of "Optional" let a UA that doesn't understand the particular options parameter still generate an MDN in response to a request for an MDN. A UA that doesn't understand the "signed-receipt-protocol" parameter, or the "signed-receipt-micalg" parameter, obviously won't return a signed receipt ๐Ÿ™ƒ.

The importance of "Optional" is used for the signed receipt parameters because it is RECOMMENDED that an MDN be returned to the requesting trading partner even if the recipient could not sign it ๐Ÿ’Œ.

The returned MDN will contain information on the disposition of the message, as well as on why the MDN could not be signed. See the Disposition field in Section 7.5 for more information ๐Ÿ”Ž.

Within an EDI trading relationship, if a signed receipt is expected and is not returned, then the validity of the transaction must be determined by the trading partners. Typically, if a signed receipt is required by the trading relationship and doesn't arrive, the transaction will likely not be considered valid ๐Ÿฅบ.


7.3.1. Signed Receipt Considerations ๐Ÿงพ

The method used to request a receipt or a signed receipt is defined in RFC 3798, "An Extensible Message Format for Message Disposition Notifications" ๐ŸŽ€.

The "rules" for processing a receipt-request are as follows ๐Ÿ’…:

  1. When a receipt is requested and it's explicitly specified that the receipt be signed, then the receipt MUST be returned with a signature unless conditions (2) or (3) below are applicable.
  2. When a receipt is requested and it's explicitly specified that the receipt be signed, but the recipient cannot support either the requested protocol format or the requested MIC algorithms, then either a signed or unsigned receipt SHOULD be returned.
  3. When a receipt is requested and it's explicitly specified that the receipt be signed, but the recipient is unable to compute the digest (for example, the message was encrypted and the recipient is unable to decrypt it), then the recipient SHOULD NOT return "Received-content-MIC" in the MDN to the requestor. If the MDN sets the disposition (for example, "processed/error: decryption-failed") appropriately, then the "Received-content-MIC" may be returned, but the value must be discarded ๐Ÿ™ˆ.
  4. When a signature is not explicitly requested, or the signed receipt request parameter is not recognized by the UA, then no receipt, an unsigned receipt, or a signed receipt MAY be returned by the recipient โœจ.
  5. If a message is received without a request for a receipt, then a receipt (signed or unsigned) MAY be returned.

The "Received-content-MIC" MUST be calculated as follows ๐Ÿงฎ:

  • For any signed messages, the MIC to be returned is calculated on the RFC 1767 MIME header and content. Canonicalization as specified in RFC 1848 MUST be performed before the MIC is calculated, since the sender requesting the signed receipt was also REQUIRED to canonicalize.
  • For encrypted, unsigned messages, the MIC to be returned is calculated on the decrypted RFC 1767 MIME header and content. The content after decryption MUST be canonicalized before the MIC is calculated.
  • For unsigned, un-encrypted messages, the MIC MUST be calculated over the message contents prior to Content-Transfer-Encoding and without the MIME or any other RFC 822 [14] headers, since these are sometimes altered or reordered by message transfer agents (MTAs) ๐ŸŒช๏ธ.

7.4. MDN Format and Value ๐ŸŽ€

This section defines the format of the AS3 Message Disposition Notification (AS3-MDN) ๐Ÿ’œ.

7.4.1. AS3-MDN General Formats

The AS3-MDN follows the MDN specification [6] except where noted in this section. The modified entity definitions in this document use the vertical-bar character, '|', to denote a logical "OR" construction. Refer to RFC 2045 for the format of MIME-message-headers ๐Ÿ“š.

The format of the AS3-MDN is:

MDN, no signature

  -RFC822/2045
    -RFC3798 (message/disposition-notification)

MDN, signature

  -RFC822/2045
    -RFC1847 (multipart/signed)
      -RFC3798 (message/disposition-notification)
      -RFC3851 (application/pkcs7-signature)

7.4.2. AS3-MDN Construction

The AS3-MDN-body is formatted as a MIME multipart/report with a report-type of "disposition-notification" ๐Ÿงฉ.

When unsigned, the transfer-layer ("outermost") entity-headers of the AS3-MDN contain the Content-Type header that specifies a content type of "multipart/report", parameters indicating the report-type, and the value of the outermost multipart boundary.

When the AS3-MDN is signed, the transfer-layer ("outermost") entity-headers of the AS3-MDN contain a Content-Type header that specifies a content type of "multipart/signed". The parameters indicate the algorithm used to compute the message digest, the signature formatting protocol (for example, pkcs7-signature), and the value of the outermost multipart boundary. The first part of the MIME multipart/signed message is an embedded MIME multipart/report of type "disposition-notification". The second part of the multipart/signed message contains a MIME application/pkcs7-signature message ๐Ÿ”.

The first part of the MIME multipart/report is a "human-readable" portion that contains a general description of the message disposition ๐Ÿ‘€. The second part of the MIME multipart/report is a "machine-readable" portion, which is defined as:

AS3-disposition-notification-content =
          [ reporting-ua-field CRLF ]
          [ mdn-gateway-field CRLF ]
          [ original-recipient-field CRLF ]
          final-recipient-field CRLF
          [ original-message-id-field CRLF ]
          AS3-disposition-field CRLF
          *( failure-field CRLF )
          *( error-field CRLF )
          *( warning-field CRLF )
          *( extension-field CRLF )
          [ AS3-received-content-MIC-field CRLF ]

It is noted that several of the optional fields defined by RFC 3798 and shown above are not relevant to a point-to-point transport such as FTP and would not normally appear in an AS3 MDN ๐Ÿ™ˆ๐Ÿ’•.

7.4.3. AS3-MDN Fields โœจ

okay so the rules for building the AS3-disposition-notification-content are basically the same as the disposition-notification-content rules in Section 7 of RFC 3798 [6] ๐Ÿ’– The only glow-ups are that the RFC 3798 disposition-field gets swapped out for the AS3-disposition-field, and the AS3-received-content-MIC field gets added ๐ŸŽ€ Wherever a name changed, we slapped "AS3-" on the front. Entities that match RFC 3798 aren't redefined here, so no need to panic ๐Ÿ’…

Refer to RFC 3798 [6] and RFC 4234 [22] for entities that are not further defined in this document ๐Ÿงš

  AS3-disposition-field = "Disposition:" disposition-mode ";"
                 AS3-disposition-type [ "/" AS3-disposition-modifier]

  disposition-mode = action-mode "/" sending-mode

  action-mode = "manual-action" / "automatic-action"

  sending-mode = "MDN-sent-manually" / "MDN-sent-automatically"

  AS3-disposition-type = "processed" / "failed"

  AS3-disposition-modifier = ( "error" / "warning" ) /
                             AS3-disposition-modifier-extension

  AS3-disposition-modifier-extension =
             "error: authentication-failed" /
             "error: decompression-failed" /
             "error: decryption-failed" /
             "error: insufficient-message-security" /
             "error: integrity-check-failed" /
             "error: unexpected-processing-error" /
             "warning: " AS3-MDN-warning-description /
             "failure: " AS3-MDN-failure-description

  AS3-MDN-warning-description = *( TEXT )

  AS3-MDN-failure-description = *( TEXT )

  AS3-received-content-MIC-field =
              "Received-content-MIC:" encoded-message-digest
              "," digest-alg-id CRLF

  encoded-message-digest =
             1*( ALPHA / DIGIT / "/" / "+" ) *3"="
             ;( i.e. base64( message-digest ) )

  digest-alg-id = "sha1" / "md5"

The "Received-content-MIC" extension field gets set once the integrity of the received message has been verified ๐Ÿ” The MIC is the base64-encoded message-digest computed over the received message with a hash function. This field is required for signed receipts but optional for unsigned receipts ๐ŸŒธ For the nitty-gritty on exactly what content the message-digest gets computed over, check out Section 7.3.1 of this document ๐Ÿ“–

The algorithm used to calculate the message digest MUST be the same as the "micalg" value the sender used in the multipart/signed message ๐Ÿฆ‹ When no signature is received, the message-digest MUST be calculated using the algorithm specified by the "micalg" value in the Disposition-Notification-Options header. When no signature is received and no micalg parameter is provided, then the SHA-1 algorithm MUST be used to calculate the digest. This field is set only when the contents of the message are processed successfully โœจ It's used together with the recipient's signature on the MDN so the sender can verify non-repudiation of receipt ๐Ÿ‘‘

AS3-MDN field names (e.g., "Disposition:", "Final-Recipient:") are case-insensitive (cf. RFC 3798, Section 3.1.1) ๐Ÿ™ˆ

AS3-MDN action-modes, sending-modes, AS3-disposition-types, and AS3-disposition-modifier values that are defined above, along with user-supplied *( TEXT ) values, are also case-insensitive ๐Ÿ“ AS3 implementations MUST NOT make assumptions regarding the values supplied for AS3-MDN-warning-description or AS3-MDN-failure-description, or for the values of any (optional) error, warning, or failure fields. No guessing allowed, bestie ๐Ÿ’€


7.4.4. Additional AS3-MDN Programming Notes ๐Ÿ’œ

  1. Unlike SMTP, for FTP transactions, Original-Recipient and Final Recipient SHOULD NOT be different. The value in Original-Message-ID MUST match the original Message-ID header value ๐Ÿซถ
  2. Refer to RFC 3462 and RFC 3798 for the formatting of the Content-Type entity-headers for the MDN ๐ŸŽ€
  3. Use an action-mode of "automatic-action" when the disposition described by the disposition type was a result of an automatic action, rather than an explicit instruction by the user for this message ๐Ÿค–
  4. Use an action-mode of "manual-action" when the disposition described by the disposition type was a result of an explicit instruction by the user rather than some sort of automatically performed action ๐Ÿ™‹โ€โ™€๏ธ
  5. Use a sending-mode of "MDN-sent-automatically" when the MDN is sent because the UA had previously been configured to do so โš™๏ธ
  6. Use a sending-mode of "MDN-sent-manually" when the user explicitly gave permission for this particular MDN to be sent ๐Ÿ’…
  7. The sending-mode "MDN-sent-manually" is ONLY meaningful with "manual-action", not with "automatic-action" ๐Ÿ”ฅ
  8. The "failed" disposition type MAY NOT be used for the situation in which there is some problem in processing the message other than interpreting the request for an MDN. The "processed" or other disposition type with appropriate disposition modifiers is to be used in such situations ๐ŸŒˆ
  9. An AS3 implementation MUST present to its trading partners an FTP-compliant server interface where inbound documents and MDNs are received ๐Ÿ“ฌ
  10. An AS3 implementation MUST be able to retrieve inbound messages from its currently configured FTP server interface ๐Ÿ“ฅ

Note: Programming Notes 9 and 10 do not imply any specific method for supplying the FTP server interface. But, they do allow for several different types of implementations. Some vendors may choose to imbed an FTP-compliant server interface within their product, and others may choose to utilize off-the-shelf FTP servers to supply the required FTP server interface. Some may choose to utilize hosting services provided by their trading partner or by a third-party hosting service. Whichever method is utilized, an AS3 implementation MUST support rules 9 and 10 ๐Ÿงš

  1. AS3 implementations MAY imbed an FTP server interface within their product ๐ŸŒธ
  2. AS3 implementations MUST be configurable to allow the use of an external FTP hosting service ๐Ÿ› ๏ธ

Note: An external FTP hosting service may be hosted by a third-party or possibly hosted by your trading partner.

  1. An AS3 implementation MUST be able to send business documents and MDNs to a trading partner's currently configured FTP server interface ๐Ÿ“ค
  2. An AS3 implementation may imbed FTP client code into their product or use a third-party FTP client ๐Ÿฆ‹
  3. Example Configurations โญ
    1. Peer to Peer Trading Partner A (TPA) is using a local FTP server, and Trading Partner B (TPB) is using an imbedded FTP server ๐ŸŽ€
[A Client] ----( connect )----> [B Server]
[A Client] ----( send )-------> [B Server] [AS3-Message]
[A Client] ----( disconnect )-> [B Server]

[A Server] <---( connect )----- [B Client]
[A Server] <---( send )-------- [B Client] [AS3-MDN]]
[A Server] <---( disconnect )-- [B Server]
[A Client] <---( GET )--------- [A Server]
  1. Third-Party Hosting Both parties are using the same third-party-hosted FTP server ๐ŸŒ
[A Client] ----( connect )----> [Hosted Server]
[A Client] ----( send )-------> [Hosted Server] [AS3-Message]
[A Client] ----( disconnect )-> [Hosted Server]
[Hosted Server]( GET )--------> [B Client]

[Hosted Server] <---( connect )----- [B Client]
[Hosted Server] <---( send )-------- [B Client] [AS3-MDN]]
[Hosted Server] <---( disconnect )-- [B Client]
[A Client]      <---( GET )--------- [Hosted Server]
  1. Trading Partner Hosting TPA is using the imbedded FTP server hosted by TPB ๐Ÿ 
[A Client] ----( connect )----> [B Server]
[A Client] ----( send )-------> [B Server] [AS3-Message]
[A Client] ----( disconnect )-> [B Server]

[B Server] <---( connect )----- [B Client]
[B Server] <---( send )-------- [B Client] [AS3-MDN]]
[B Server] <---( disconnect )-- [B Client]
[A Client] <---( GET )--------- [B Server]

7.5. Disposition Mode, Type, and Modifier ๐ŸŒŸ

7.5.1. Disposition Mode Overview ๐Ÿ”

This section will provide a brief overview of how processed, error, failure, or warning notifications are used ๐Ÿง

7.5.2. Successful Processing Status Indication ๐ŸŽ‰

When a receipt or signed receipt is requested, and the received message contents are successfully processed by the receiving EDI UA, a receipt or MDN SHOULD be returned with the "disposition-type" set to "processed" โœ… When the MDN is sent automatically by the EDI UA, and there is no explicit way for a user to control the sending of the MDN, then the first part of the "disposition-mode" should be set to "automatic-action" ๐Ÿค–

When the MDN is being sent under user-configurable control, then the first part of the "disposition-mode" should be set to "manual-action" ๐Ÿ™‹โ€โ™€๏ธ Since a request for a signed receipt should always be honored, the user MUST not be allowed to configure the UA not to send a signed receipt when the sender requests one ๐Ÿšซ

The second part of the "disposition-mode" is set to "MDN-sent-manually" if the user gave explicit permission for the MDN to be sent ๐Ÿ’Œ Again, the user MUST not be allowed to explicitly refuse to send a signed receipt when the sender requests one ๐Ÿฅน The second part of the "disposition-mode" is set to "MDN-sent-automatically" whenever the EDI UA sends the MDN automatically, regardless of whether the sending was under a user's, an administrator's, or software control โš™๏ธ

Since EDI content is generally handled automatically by the EDI UA, a request for a receipt or signed receipt will generally return the following in the "disposition-field":

Disposition: automatic-action/MDN-sent-automatically; processed

Note this specification does not restrict the use of the "disposition-mode" to just automatic actions ๐Ÿ’ซ Manual actions are valid as long as it is kept in mind that a request for a signed receipt MUST be honored ๐Ÿซถ

7.5.3. Unsuccessful Processed Content ๐ŸŽ€

okay bestie so asking for a signed receipt takes two "disposition-notification-options" ๐Ÿงพ. One says which protocol format the signed receipt comes back in, and the other says which MIC algorithm got used to calculate the MIC over the message contents. Now if the message content is getting rejected or ignored, the "disposition-field" values you use get spelled out right in the MDN "disposition-field" ๐Ÿ’…. (Example: the EDI UA figures out it can't send back a signed receipt because it doesn't support the requested protocol format, so it just decides not to process the contents itself. Valid choice honestly ๐Ÿ’€.)

Disposition: "disposition-mode"; failed/Failure: unsupported Format

The "failed" AS3-disposition-type is for when a failure happens that stops the MDN from being generated properly ๐Ÿ˜ญ. For example, this disposition-type would apply if the sender asked for an unsupported message-integrity-check (MIC) algorithm to be applied. The "failure:" AS3-disposition-modifier-extension should come with an implementation-defined description of the failure ๐Ÿ”ฅ. More info about the failure can go in a failure-field. The "failed" disposition-type syntax is super general, so you can send any textual info along with it. Implementations WILL support any printable textual characters after the Failure disposition-type โœจ.

For Internet EDI, these "failed" values are pre-defined and MUST be supported ๐Ÿ‘‘:

"Failure: unsupported format"
"Failure: unsupported MIC-algorithms"

7.5.4. Unsuccessful Non-Content Processing ๐Ÿ™ˆ

okay so when errors pop up while processing the received message (and it's NOT about the content), the "disposition-field" should be set to the "processed" disposition-type value and the "error" disposition-modifier value ๐Ÿซถ.

The "error" AS3-disposition-modifier paired with the "processed" disposition-type says that some sort of error happened and stopped the message from being processed successfully ๐Ÿ˜ฉ. More info can go in an error-field.

An "error:" AS3-disposition-modifier-extension is how you combine the error with a pre-defined description of a specific, well-known error ๐Ÿงš. Further info about it can go in an error-field too.

For Internet EDI, these "error" "disposition-modifier" values are defined:

  • "Error: decryption-failed": the receiver could not decrypt the message contents ๐Ÿ”.
  • "Error: authentication-failed": the receiver could not authenticate the sender ๐Ÿ™…โ€โ™€๏ธ.
  • "Error: integrity-check-failed": the receiver could not verify content integrity ๐Ÿ’”.
  • "Error: insufficient-message-security": the security level of the message didn't match the level agreed between TPs ๐Ÿšซ.
  • "Error: decompression-failed": the receiver could not decompress the message contents ๐Ÿ“ฆ.
  • "Error: unexpected-processing-error": the catch-all for any other processing errors ๐Ÿงบ.

Here's how the "disposition-field" would look when non-content processing errors are detected ๐Ÿ“:

Disposition: "disposition-mode";
  processed/Error: decryption-failed

7.5.5. Processing Warnings โญ

situations arise in EDI where even if a trading partner can't be authenticated correctly, the trading partners still agree to keep processing the EDI transactions ๐Ÿค. Transaction reconciliation gets done between them at a later time. In the content processing warning situations described above, the "disposition-field" SHOULD be set to the "processed" disposition-type value and the "warning" disposition-modifier value ๐ŸŒˆ.

The "warning" AS3-disposition-modifier goes with the "processed" disposition-type to show that the message was processed successfully, but something exceptional happened along the way ๐Ÿฆ‹. More info can go in a warning-field.

A "warning:" AS3-disposition-modifier-extension combines the warning with an implementation-defined description of it. Further info can go in a warning-field ๐Ÿ’œ.

For Internet EDI, this "warning" "disposition-modifier" value is defined:

  • "Warning: authentication-failed, processing continued"

And here's how the "disposition-field" looks when processing warnings (not content) are detected:

Disposition: "disposition-mode"; processed/Warning:
  authentication-failed, processing continued

8. Public Key Certificate Handling ๐Ÿ”

in the near term, the exchange of public keys and the certification of those keys must be handled as part of setting up a trading partnership ๐Ÿ’Œ. The UA and/or EDI application interface must keep a database of the public keys used for encryption or signatures, plus the mapping between an EDI trading partner ID and an FTP URL/URI ๐Ÿ—‚๏ธ. How you set up a trading partnership and configure the secure EDI messaging system might vary between trading partners and software packages.

X.509 certificates are REQUIRED ๐Ÿ“œ. It is RECOMMENDED that trading partners self-certify each other if they aren't using an agreed-upon certification authority. This applicability statement does NOT require the use of a certification authority ๐Ÿ™Œ.

So using a certification authority is OPTIONAL. Certificates may be self-signed. It is RECOMMENDED that when trading partners are using S/MIME, they also exchange public key certificates using the recommendations in the S/MIME Version 3.1 Message Specification โœจ.

The message formats and S/MIME conformance requirements for certificate exchange are specified in this document ๐Ÿ’–. Long term, additional Internet-EDI standards may be developed to make setting up a trading partnership easier. That could include third-party authentication of trading partners, plus the attributes of the trading relationship ๐Ÿฆ‹.

9. Security Considerations ๐Ÿšจ

this entire document is about secure transport of business-to-business data, and it considers both privacy and authentication issues ๐Ÿ”’. Please take this section seriously, bestie ๐Ÿ˜ญ.

From the S/MIME Version 2 Message Specification [21]: 40-bit encryption is considered weak by most cryptographers, and weak cryptography in S/MIME offers little real security over sending plaintext ๐Ÿ’€. Other S/MIME features, like tripleDES and the ability to announce stronger cryptographic capabilities to the parties you talk to, let senders create messages that use strong encryption โœจ. Weak cryptography is never recommended unless the only alternative is no cryptography at all. When it's feasible, sending and receiving agents should tell senders and recipients how strong the cryptography in a message is ๐Ÿ”ฅ.

From the S/MIME Version 3.1 Certificate Handling [11]: when processing certificates, lots of things can go wrong. The processing might be done by a user agent, a security gateway, or some other program, so there's no single way to handle every failure. Just because the failure handling isn't listed doesn't mean it's unimportant. Actually, it's the opposite: if a certificate isn't provably valid and associated with the message, the processing software should take immediate and noticeable steps to inform the end user ๐Ÿšจ.

Some of the many places where signature and certificate checking might fail include ๐Ÿ‘€:

  • no Internet mail address in a certificate matches the sender of the message, if the certificate contains at least one mail address
  • no certificate chain leads to a trusted CA
  • no ability to check the Certificate Revocation List (CRL) for a certificate
  • an invalid CRL was received
  • the CRL being checked is expired
  • the certificate is expired
  • the certificate has been revoked

There are definitely other ways a certificate can be invalid, and it's the processing software's responsibility to check them all thoroughly and decide what to do when a check fails ๐Ÿง.

The following certificate types MUST be supported ๐ŸŽ€:

  • With URL
  • Without URL
  • Self Certified
  • Certification Authority Certified

The complete certification chain MUST be included in all certificates ๐Ÿ”—. All certificate verifications MUST "chain to root". Also, the certificate hash should match the hash recomputed by the receiver ๐Ÿ’….

10. References ๐Ÿ“š

10.1. Normative References

  • [1] Freed, N. and N. Borenstein, "Multipurpose Internet Mail Extensions (MIME) Part One: Format of Internet Message Bodies", RFC 2045, November 1996.
    • Freed, N. and N. Borenstein, "Multipurpose Internet Mail Extensions (MIME) Part Two: Media Types", RFC 2046, November 1996.
    • Freed, N. and N. Borenstein, "Multipurpose Internet Mail Extensions (MIME) Part Five: Conformance Criteria and Examples", RFC 2049, November 1996.
  • [2] Crocker, D., "MIME Encapsulation of EDI Objects", RFC 1767, March 1995.
  • [3] Postel, J. and J. Reynolds, "File Transfer Protocol", STD 9, RFC 959, October 1985.
  • [4] Horowitz, M. and S. Lunt, "FTP Security Extensions", RFC 2228, October 1997.
  • [5] Harding, T., Drummond, R., and C. Shih, "MIME-based Secure Peer-to-Peer Business Data Interchange over the Internet", RFC 3335, September 2002.
  • [6] Hansen, T. and G. Vaudreuil, "Message Disposition Notification", RFC 3798, May 2004.
  • [7] Galvin, J., Murphy, S., Crocker, S., and N. Freed, "Security Multiparts for MIME: Multipart/Signed and Multipart/Encrypted", RFC 1847, October 1995.
  • [8] Klensin, J., "Simple Mail Transfer Protocol", RFC 2821, April 2001.
  • [9] Housley, R., "Cryptographic Message Syntax (CMS)", RFC 3852, July 2004.
  • [10] Ramsdell, B., "Secure/Multipurpose Internet Mail Extensions (S/MIME) Version 3.1 Message Specification", RFC 3851, July 2004.
  • [11] Ramsdell, B., "Secure/Multipurpose Internet Mail Extensions (S/MIME) Version 3.1 Certificate Handling", RFC 3850, July 2004.
  • [12] Vaudreuil, G., "The Multipart/Report Content Type for the Reporting of Mail System Administrative Messages", RFC 3462, January 2003.
  • [13] Dierks, T. and C. Allen, "The TLS Protocol Version 1.0", RFC 2246, January 1999.
  • [14] Crocker, D., "STANDARD FOR THE FORMAT OF ARPA INTERNET TEXT MESSAGES", STD 11, RFC 822, August 1982.
  • [15] Resnick, P., "Internet Message Format", RFC 2822, April 2001.
  • [16] Murata, M., St. Laurent, S., and D. Kohn, "XML Media Types", RFC 3023, January 2001.
  • [17] Gutmann, P., "Compressed Data Content Type for Cryptographic Message Syntax (CMS)", RFC 3274, June 2002.
  • [18] Ford-Hutchinson, P., "Securing FTP with TLS", RFC 4217, October 2005.
  • [19] Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, March 1997.

10.2. Informative References โœจ

Okay so the informative references are where the bibliography goes for the stuff that's helpful background but not strictly required to implement this. Here they are, bestie ๐Ÿ“š

  • [20] Harding, T., "Compressed Data for EDIINT", Work in Progress, January 2007. ๐ŸŒธ
  • [21] Dusse, S., Hoffman, P., Ramsdell, B., Lundblade, L., and L. Repka, "S/MIME Version 2 Message Specification", RFC 2311, March 1998. ๐Ÿ’Œ
  • [22] Crocker, D. and P. Overell, "Augmented BNF for Syntax Specifications: ABNF", RFC 4234, October 2005. ๐Ÿงš
  • [23] Dierks, T. and E. Rescorla, "The Transport Layer Security (TLS) Protocol Version 1.1", RFC 4346, April 2006. ๐Ÿ”

Appendix A. Message Examples ๐ŸŽ€

NOTE: All examples are provided as an illustration only, and are not considered part of the protocol specification. If an example conflicts with the protocol definitions specified above or with that of a referenced RFC, the example is wrong. ๐Ÿ™ˆ Like, the examples are cute but they are NOT the rulebook, periodt.

A.1. Signed Message Requesting a Signed Receipt ๐Ÿ’–

Here's a signed message that asks for a signed receipt back. The headers do all the talking here, so read them carefully ๐Ÿ‘€

Date: Wed, 31 Jul 2002 13:34:50 GMT
AS3-Version: 1.0
AS3-From:  cyclone
AS3-To: "trading partner"
Message-Id: <200207310834482A70BF63@host.com>
Disposition-Notification-To: ftp://host:port/mdnbox
Disposition-Notification-Options: signed-receipt-
  protocol=optional,pkcs7-signature;
  signed-receipt-micalg=optional,sha1
Content-Type: multipart/signed; boundary="as3BouNdary1as3";
   protocol="application/pkcs7-signature"; micalg=sha1
Content-Length: 3075

--as3BouNdary1as3
Content-Type: application/edi-x12
Content-Disposition: Attachment; filename=rfc1767.dat

[ISA ...EDI transaction data...IEA...]

--as3BouNdary1as3
Content-Type: application/pkcs7-signature

  [omitted binary pkcs7 signature data]
--as3BouNdary1as3--

A.2. MDN for Message A.1 Above ๐Ÿฆ‹

And here's the receipt that comes back for that message. It's giving full paperwork energy, ngl ๐Ÿ’…

Date: Wed, 31 Jul 2002 13:34:50 GMT
AS3-From: "trading partner"
AS3-To: cyclone
AS3-Version: 1.0
Message-ID: <709700825.1028122454671.JavaMail@ediXchange>
Content-Type: multipart/signed; micalg=sha1;
  protocol="application/pkcs7-signature";
  boundary="----=_Part_57_648441049.1028122454671"
Content-Length: 1024

------=_Part_57_648441049.1028122454671
& Content-Type: multipart/report;
&   Report-Type=disposition-notification;
&   boundary="----=_Part_56_1672293592.1028122454656"
&
&------=_Part_56_1672293592.1028122454656
&Content-Type: text/plain
&Content-Transfer-Encoding: 7bit
&
&MDN for -
& Message ID: <200207310834482A70BF63@host.com>
&  From: cyclone
&  To: "trading partner"
&  Received on: 2002-07-31 at 09:34:14 (EDT)
&  Status: processed
&  Comment: This is not a guarantee that the message has been
&  completely processed or understood by the receiving translator
&
&------=_Part_56_1672293592.1028122454656
&   Content-Type: message/disposition-notification
&   Content-Transfer-Encoding: 7bit
&
&   Reporting-UA: AS3 Server
&   Original-Recipient: rfc822; "trading partner"
&   Final-Recipient: rfc822; "trading partner"
&   Original-Message-ID: <200207310834482A70BF63@host.com>
&   Received-content-MIC: 7v7F++fQaNB1sVLFtMRp+dF+eG4=, sha1
&   Disposition: automatic-action/MDN-sent-automatically; processed
&
&------=_Part_56_1672293592.1028122454656--

    ------=_Part_57_648441049.1028122454671
Content-Type: application/pkcs7-signature; name=smime.p7s
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename=smime.p7s

MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQ
cp24hMJNbxDKHnlB9jTiQzLwSwo+/90Pc87x+Sc6EpFSUYWGAAAAAAAA
------=_Part_57_648441049.1028122454671--

Notes:

  1. The lines proceeded with "&" are what the signature is calculated over. ๐Ÿ”‘
  2. For details on how to prepare the multipart/signed with protocol="application/pkcs7-signature", see RFC 3851 [10], "Secure/Multipurpose Internet Mail Extensions (S/MIME) Version 3.1 Message Specification". ๐Ÿ“–
  3. Note that the textual first body part of the multipart/report can be used to include a more detailed explanation of the error conditions reported by the disposition headers. The first body part of the multipart/report, when used in this way, allows a person to better diagnose a problem in detail. ๐Ÿ•ต๏ธโ€โ™€๏ธ
  4. As specified by RFC 3462 [12], returning the original or portions of the original message in the third body part of the multipart/report is not required. This is an optional body part. However, it is RECOMMENDED that this body part be omitted or left blank. ๐Ÿซถ

Authors' Addresses ๐ŸŒˆ

Terry Harding Axway 8388 E. Hartford Drive, Suite 100 Scottsdale, AZ 85255 USA

EMail: tharding@us.axway.com

Richard Scott Axway 8388 E. Hartford Drive, Suite 100 Scottsdale, AZ 85255 USA

EMail: rscott@us.axway.com


Copyright (C) The IETF Trust (2007).

This document is subject to the rights, licenses and restrictions contained in BCP 78, and except as set forth therein, the authors retain all their rights.

This document and the information contained herein are provided on an "AS IS" basis and THE CONTRIBUTOR, THE ORGANIZATION HE/SHE REPRESENTS OR IS SPONSORED BY (IF ANY), THE INTERNET SOCIETY, THE IETF TRUST AND THE INTERNET ENGINEERING TASK FORCE DISCLAIM ALL WARRANTIES, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTY THAT THE USE OF THE INFORMATION HEREIN WILL NOT INFRINGE ANY RIGHTS OR ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.


Intellectual Property ๐Ÿ’œ

The IETF takes no position regarding the validity or scope of any Intellectual Property Rights or other rights that might be claimed to pertain to the implementation or use of the technology described in this document or the extent to which any license under such rights might or might not be available; nor does it represent that it has made any independent effort to identify any such rights. Information on the procedures with respect to rights in RFC documents can be found in BCP 78 and BCP 79.

Copies of IPR disclosures made to the IETF Secretariat and any assurances of licenses to be made available, or the result of an attempt made to obtain a general license or permission for the use of such proprietary rights by implementers or users of this specification can be obtained from the IETF on-line IPR repository at http://www.ietf.org/ipr.

The IETF invites any interested party to bring to its attention any copyrights, patents or patent applications, or other proprietary rights that may cover technology that may be required to implement this standard. Please address the information to the IETF at ietf-ipr@ietf.org.


Acknowledgement ๐ŸŒธ

Funding for the RFC Editor function is currently provided by the Internet Society.

๐Ÿ“ฆ where this page comes from