RFC 9119
Multicast Considerations over IEEE 802 Wireless Media
Title Block โจ RFC 9119: Multicast Considerations over IEEE 802 Wireless Media ๐ฆ
okay bestie, so this doc is from the IETF (the Internet Engineering Task Force, the crew that writes the rules for how the internet talks ๐). It's Request for Comments 9119 and it was published in October 2021 ๐. The lead author is C. Perkins at Lupin Lodge, with co-authors M. McBride (Futurewei), D. Stanley (HPE), W. Kumari (Google), and JC. Zรบรฑiga (SIGFOX) ๐. It's Informational, which means it's not a Standards Track spec, it's just here to share knowledge ๐ง. Nothing in this RFC obsoletes or updates any earlier RFCs, and it has ISSN 2070-1721 โญ.
Abstract ๐ธ
Multicast is the main character that keeps getting left on read ๐ญ. Known multicast issues have stopped it from being deployed on 802.11 (Wi-Fi) and other local-area wireless networks ๐. This doc covers the known limitations of wireless Layer 2 multicast, mostly 802.11 ๐. It also covers multicast enhancement features that the IETF and IEEE 802 have specified for wireless, plus some operational choices that can make the network run better โจ. Last but not least, it gives some recommendations on how to use these features and choices together ๐ซถ.
Status of This Memo ๐
Okay, the vibe here is: this is not an Internet Standards Track spec, it's published for info only ๐. It's still a product of the IETF and it reflects the consensus of the IETF community ๐. It got public review and was approved by the Internet Engineering Steering Group (IESG) ๐ฅ. Not everything the IESG approves is up for any level of Internet Standard, so check Section 2 of RFC 7841 if you want the full tea ๐ต. For the current status, errata, or to give feedback, head to https://www.rfc-editor.org/info/rfc9119 ๐ฆ.
Copyright Notice ๐
Copyright (c) 2021 IETF Trust and the document authors. All rights reserved ๐. This doc is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/license-info) as they stood on the publication date ๐. Please actually read those, they lay out your rights and restrictions ๐. Code components pulled out of this doc have to include the Simplified BSD License text, as described in Section 4.e of the Trust Legal Provisions, and they come with no warranty ๐.
Table of Contents ๐ง
1. Introduction
2. Terminology
3. Identified Multicast Issues
3.1. Issues at Layer 2 and Below
3.1.1. Multicast Reliability
3.1.2. Lower and Variable Data Rate
3.1.3. Capacity and Impact on Interference
3.1.4. Power-Save Effects on Multicast
3.2. Issues at Layer 3 and Above
3.2.1. IPv4 Issues
3.2.2. IPv6 Issues
3.2.3. MLD Issues
3.2.4. Spurious Neighbor Discovery
4. Multicast Protocol Optimizations
4.1. Proxy ARP in 802.11-2012
4.2. IPv6 Address Registration and Proxy Neighbor Discovery
4.3. Buffering to Improve Battery Life
4.4. Limiting Multicast Buffer Hardware Queue Depth
4.5. IPv6 Support in 802.11-2012
4.6. Using Unicast Instead of Multicast
4.6.1. Overview
4.6.2. Layer 2 Conversion to Unicast
4.6.3. Directed Multicast Service (DMS)
4.6.4. Automatic Multicast Tunneling (AMT)
4.7. GroupCast with Retries (GCR)
5. Operational Optimizations
5.1. Mitigating Problems from Spurious Neighbor Discovery
5.2. Mitigating Spurious Service Discovery Messages
6. Multicast Considerations for Other Wireless Media
7. Recommendations
8. Ongoing Discussion Items
9. Security Considerations
10. IANA Considerations
11. Informative References
Acknowledgements
Authors' Addresses
1. Introduction โจ
Okay so, multicast has big problems that have kept it from being deployed on 802.11 [dot11] and other local-area wireless networks, as [mc-props] and [mc-prob-stmt] describe ๐ฅบ. People have noticed performance issues when multicast packets from IETF protocols go over IEEE 802 wireless media ๐. Both the IETF and IEEE 802 have designed enhancements for multicast, but the specs, implementations, and config choices still don't always play nice together ๐.
Lots of IETF protocols lean on multicast or broadcast to deliver control messages to many receivers at once ๐. Multicast lets data reach several interested recipients without the source sending a copy to each one ๐ฆ. Broadcast is different, because it goes to every device whether or not they care ๐ญ. Multicast gets used for things like Neighbor Discovery, network flooding, and address resolution, and it saves medium time when the same data is meant for many receivers ๐ธ. Beyond protocol control traffic, apps are also sending multicast IP to end-user devices now, like Push To Talk in hospitals or video in enterprises, universities, and homes, and those devices are increasingly on Wi-Fi ๐กโจ.
IETF protocols usually count on network layering so higher-level protocols don't depend on the details of the MAC layer or the physical medium ๐ง. For multicast, higher-level protocols have traditionally been designed as if sending a packet to an IP address costs the same in interference and medium access, whether the destination is unicast, multicast, or broadcast ๐คทโโ๏ธ. That made sense for wired media like Ethernet ๐. Sadly, for lots of wireless media the cost of accessing the medium can be super different ๐. Multicast over Wi-Fi has often had such poor performance that it's been disallowed ๐ โโ๏ธ. Some IETF protocol enhancements assume wireless and are meant to work mainly over it, but they're usually only deployed in limited settings and aren't widespread on most wireless networks ๐ฅ.
IEEE 802 wireless protocols do have features built in to support multicast traffic ๐. For example, lower modulations are used for multicast frames so every station in the cell can receive them, no matter how far away they are or how much the signal has attenuated from the base station or Access Point (AP) ๐ถ. The catch is that these lower modulation transmissions hog the medium for longer, and they slow down efficient traffic to nearby stations using higher-order modulations ๐. For these reasons and others, IEEE 802 Working Groups like 802.11 have designed features to improve multicast performance at Layer 2 [ietf_802-11] ๐ ๏ธ. Operational and config enhancements can also ease the network problems multicast traffic causes, as Section 5 explains ๐.
There seems to be general agreement that these problems won't be fixed anytime soon, mostly because fixing them is expensive and because multicast is unreliable ๐ธ. Compared to unicast over Wi-Fi, multicast is often treated as a second-class citizen, even though plenty of protocols use it ๐ค. Something needs to be provided to make multicast more reliable ๐ซถ. IPv6 Neighbor Discovery saturating the Wi-Fi link is only part of the problem ๐. Wi-Fi traffic classes may help ๐ค. This doc is meant to help figure out which problems the IETF should solve and which ones the IEEE should solve (see Section 8) ๐ง.
This doc details the problems caused by multicast over wireless networks, including high packet error rates, no acknowledgements, and low data rates ๐. It also explains some enhancements the IETF and IEEE 802.11 have designed to soften the effects of the radio medium on multicast traffic ๐. Recommendations for implementors on how to use and combine these enhancements are included, plus some advice about operational choices ๐. This doc will probably also be relevant to designers of future IEEE wireless specs ๐ฎ.
2. Terminology ๐
This doc uses these definitions:
- ACK: the 802.11 Layer 2 acknowledgement ๐ .
- AES-CCMP: AES-Counter Mode CBC-MAC Protocol ๐.
- AP: IEEE 802.11 Access Point ๐ก.
- Basic rate: the slowest rate of all the connected devices at which multicast and broadcast traffic is generally transmitted ๐ข.
- DVB-H: Digital Video Broadcasting - Handheld ๐บ.
- DVB-IPDC: Digital Video Broadcasting - Internet Protocol Datacasting ๐บ.
- DTIM: Delivery Traffic Indication Map; an information element that advertises whether or not any associated stations have buffered multicast or broadcast frames ๐ฃ.
- MCS: Modulation and Coding Scheme ๐๏ธ.
- NOC: Network Operations Center ๐ฅ๏ธ.
- PER: Packet Error Rate ๐.
- STA: 802.11 station (e.g., handheld device) ๐ฑ.
- TIM: Traffic Indication Map; an information element that advertises whether or not any associated stations have buffered unicast frames ๐ฌ.
- TKIP: Temporal Key Integrity Protocol ๐.
- WiMAX: Worldwide Interoperability for Microwave Access ๐ถ.
- WPA: Wi-Fi Protected Access ๐ก๏ธ.
3. Identified Multicast Issues ๐ฉ
3.1. Issues at Layer 2 and Below ๐งฑ
In this section, we go over some of the problems with using multicast over IEEE 802 wireless tech ๐ซ.
3.1.1. Multicast Reliability ๐ญ
Multicast traffic is usually way less reliable than unicast ๐. Multicast is point-to-multipoint, so you'd need multiple acknowledgements to guarantee every recipient gets it ๐. But multicast packets have no ACKs, so the AP can't tell whether a retransmission is needed ๐คทโโ๏ธ. Even on the wired Internet this often causes undesirably high error rates ๐ฅด. That's a big reason multicast apps have been slow to catch on, even though the protocols have been around forever ๐ฐ๏ธ. Wireless links are way worse and super sensitive to background traffic ๐ถ๐. So there can be a high packet error rate (PER) because nothing retransmits and the sender never backs off ๐ซ . PER is the percentage of packets the device didn't successfully receive ๐. It's not unusual to see a packet loss rate of 5% or more, which is especially rough for video and other stuff that needs high data rates and high reliability ๐ฌ๐ฉ.
Part 1 of 6. Keep your seat, the rest of the RFC is coming next ๐๐
3.1.2. Lower and Variable Data Rate ๐ข
okay so multicast over wired is NOT the same vibe as multicast over wireless, bestie ๐ wired links usually run at a fixed rate, but Wi-Fi's transmission rate changes depending on how close the STA is to the AP ๐ถ. so when a device moves around, the throughput of video flows and the capacity of the whole Wi-Fi network shifts too ๐ญ. that makes it hard for QoS solutions to reserve bandwidth and do admission control properly ๐.
For wireless stations that are authenticated and linked with an AP, the power needed for good reception can differ from station to station ๐. with unicast, the goal is to minimize power while maximizing the data rate to the destination โก. with multicast it's a totally different energy: the goal is just to maximize the number of receivers that correctly get the multicast packet ๐ซถ. so generally the AP has to use a much lower data rate, at a power level high enough for even the farthest station to receive the packet (this is briefly mentioned in Section 4 of [RFC5757], fyi ๐ง). which means the data rate of a video stream, for instance, gets constrained by the environmental considerations of the least-reliable receiver associated with the AP ๐.
Because more robust modulation and coding schemes (MCSs) have a longer range but a lower data rate, multicast/broadcast traffic is generally sent at the slowest rate of all the connected devices. this is also called the basic rate ๐. how much extra interference that causes depends on the specific wireless technology ๐. and get this: backward compatibility and multi-stream implementations mean the maximum unicast rates are currently up to a few Gbps, so there can be more than 3 orders of magnitude difference in transmission rate between multicast/broadcast and optimal unicast forwarding ๐คฏ. some techniques used to boost spectral efficiency, like spatial multiplexing in Multiple Input Multiple Output (MIMO) systems, aren't available with more than one intended receiver ๐ฆ. it is not the case that backwards compatibility is the only factor behind the lower multicast transmission rates, periodt ๐.
Wired multicast also affects wireless LANs when the AP extends the wired segment. in that case, multicast/broadcast frames on the wired LAN side are copied to the Wireless Local Area Network (WLAN). since broadcast messages go out at the most robust MCS, many large frames get sent at a slow rate over the air ๐ฅฒ.
3.1.3. Capacity and Impact on Interference ๐
Transmissions at a lower rate need longer occupancy of the wireless medium ๐ฉ, which takes airtime away from other communications and degrades the overall capacity. plus, transmitting at higher power (which is required to reach all multicast STAs associated with the AP) proportionately increases the area of interference with other consumers of the radio spectrum ๐ก๐ฅ.
3.1.4. Power-Save Effects on Multicast ๐๐ค
one of the characteristics of multicast transmission over Wi-Fi is that every station has to be configured to wake up to receive the multicast frame, even though the received packet may end up being discarded ๐ค. this process can have a big effect on the power consumption of the multicast receiver station ๐ชซ. that's why there are workarounds, like Directed Multicast Service (DMS) described in Section 4, to prevent stations from waking up unnecessarily ๐.
Multicast (and unicast) can work poorly with the power-save mechanisms defined in IEEE 802.11e, for the following reasons ๐ฅฒ:
- Clients may be unable to stay in sleep mode due to multicast control packets frequently waking them up.
- A unicast packet is delayed until an STA wakes up and requests it. Unicast traffic may also be delayed to improve power save and efficiency and to increase the probability of aggregation.
- Multicast traffic is delayed in a wireless network if any of the STAs in that network are power savers. All STAs associated with the AP have to be awake at a known time to receive multicast traffic.
- Packets can also be discarded due to buffer limitations in the AP and non-AP STA.
3.2. Issues at Layer 3 and Above ๐
This section identifies some representative IETF protocols and describes possible negative effects due to performance degradation when multicast transmissions are used for control messages ๐ต๏ธ. common uses of multicast include:
- Control plane signaling
- Neighbor Discovery
- Address resolution
- Service Discovery
- Applications (video delivery, stock data, etc.)
- On-demand routing
- Backbone construction
- Other Layer 3 protocols (non-IP)
User Datagram Protocol (UDP) is the most common transport-layer protocol for multicast applications ๐ฆ. by itself, UDP is not reliable -- messages may be lost or delivered out of order ๐ฌ.
3.2.1. IPv4 Issues ๐งญ
The following list has some representative discovery protocols that use broadcast/multicast and are used with IPv4:
- ARP [RFC0826]
- DHCP [RFC2131]
- Multicast DNS (mDNS) [RFC6762]
- Universal Plug and Play (uPnP) [RFC6970]
After initial configuration, ARP (described in more detail later), DHCP, and uPnP happen way less often, but service discovery can happen at any time ๐. some widely deployed service discovery protocols (e.g., for finding a printer) use mDNS (i.e., multicast), which is often dropped by operators ๐จ๏ธ. even if multicast snooping [RFC4541] is used (which saves bandwidth on the segments of the network where no node has expressed interest in receiving packets addressed to the group address ๐ช), many devices can register at once and cause serious network degradation ๐ฅ.
3.2.2. IPv6 Issues ๐
IPv6 makes extensive use of multicast, including the following:
- DHCPv6 [RFC8415]
- Protocol Independent Multicast (PIM) [RFC7761]
- IPv6 Neighbor Discovery Protocol (NDP) [RFC4861]
- Multicast DNS (mDNS) [RFC6762]
- Router Discovery [RFC4286]
IPv6 NDP Neighbor Solicitation (NS) messages used in Duplicate Address Detection (DAD) and address lookup make use of link-scope multicast. unlike IPv4, an IPv6 node will typically use multiple addresses and may change them often for privacy reasons ๐ถ๏ธ. this intensifies the impact of multicast messages that are associated with the mobility of a node ๐. router advertisement (RA) messages are also periodically multicast over the link ๐ข.
Neighbors may be considered lost if several consecutive Neighbor Discovery packets fail ๐ป.
3.2.3. MLD Issues ๐งฉ
Multicast Listener Discovery (MLD) [RFC4541] is used to identify members of a multicast group that are connected to the ports of a switch ๐. forwarding multicast frames into a Wi-Fi-enabled area can use switch support for hardware forwarding state information. however, since IPv6 makes heavy use of multicast, each STA with an IPv6 address will require state on the switch for several and possibly many solicited-node multicast addresses ๐ตโ๐ซ. a solicited-node multicast address is an IPv6 multicast address used by NDP to verify whether an IPv6 address is already used by the local link ๐. multicast addresses that do not have forwarding state installed (perhaps due to hardware memory limitations on the switch) cause frames to be flooded on all ports of the switch ๐. some switch vendors do not support MLD for link-scope multicast due to the increase it can cause in state ๐ โโ๏ธ.
3.2.4. Spurious Neighbor Discovery ๐
On the Internet, there is a "background radiation" of scanning traffic (people scanning for vulnerable machines) and backscatter (responses from spoofed traffic, etc.) ๐. this means routers very often receive packets destined for IPv4 addresses regardless of whether those IP addresses are in use ๐. in the cases where the IP is assigned to a host, the router broadcasts an ARP request, receives an ARP reply, and caches it; then, traffic can be delivered to the host ๐ฌ. when the IP address is not in use, the router broadcasts one (or more) ARP requests and never gets a reply. this means that it does not populate the ARP cache, and the next time there is traffic for that IP address, the router will rebroadcast the ARP requests ๐.
The rate of these ARP requests is proportional to the size of the subnets, the rate of scanning and backscatter, and how long the router keeps state on non-responding ARPs ๐. as it turns out, this rate is inversely proportional to how occupied the subnet is (valid ARPs end up in a cache, stopping the broadcasting; unused IPs never respond, and so cause more broadcasts) ๐ค. depending on the address space in use, the time of day, how occupied the subnet is, and other unknown factors, thousands of broadcasts per second have been observed. around 2,000 broadcasts per second have been observed at the IETF NOC during face-to-face meetings ๐คฏ.
With Neighbor Discovery for IPv6 [RFC4861], nodes accomplish address resolution by multicasting a Neighbor Solicitation that asks the target node to return its link-layer address ๐. Neighbor Solicitation messages are multicast to the solicited-node multicast address of the target address. the target returns its link-layer address in a unicast Neighbor Advertisement message ๐. a single request-response pair of packets is sufficient for both the initiator and the target to resolve each other's link-layer addresses; the initiator includes its link-layer address in the Neighbor Solicitation ๐ซ.
On a wired network, there is not a huge difference between unicast, multicast, and broadcast traffic ๐. due to hardware filtering (see, e.g., [Deri-2010]), inadvertently flooded traffic (or excessive Ethernet multicast) on wired networks can be quite a bit less costly compared to wireless cases where sleeping devices have to wake up to process packets ๐๏ธ. wired Ethernets tend to be switched networks, further reducing interference from multicast ๐. there is effectively no collision / scheduling problem except at extremely high port utilizations โ .
This is not true in the wireless realm. wireless equipment is often unable to send high volumes of broadcast and multicast traffic, causing numerous broadcast and multicast packets to be dropped ๐ซ . consequently, when a host connects, it is often not able to complete DHCP, and IPv6 RAs get dropped, leading to users being unable to use the network ๐ญ.
4. Multicast Protocol Optimizations โจ
This section lists some optimizations that have been specified in IEEE 802 and IETF that are aimed at reducing or eliminating the issues discussed in Section 3 ๐.
4.1. Proxy ARP in 802.11-2012
okay so the AP knows the MAC address and IP address for every associated STA ๐ which makes it the central "manager" for all the 802.11 STAs in its Basic Service Set (BSS) ๐. Proxy ARP is super easy to implement at the AP and it's giving multiple perks:
- Reduced broadcast traffic (transmitted at low MCS) on the wireless medium.
- STA benefits from extended power save in sleep mode, as ARP requests for STA's IP address are handled instead by the AP.
- ARP frames are kept off the wireless medium.
- No changes are needed to STA implementation.
here's the spec language from clause 10.23.13 of [dot11-proxyarp] ๐ค, quoted exactly because it's serious business:
"[...] the AP shall maintain a Hardware Address to Internet Address mapping for each associated station, and shall update the mapping when the Internet Address of the associated station changes. When the IPv4 address being resolved in the ARP request packet is used by a non-AP STA currently associated to the BSS, the proxy ARP service shall respond on behalf of the STA to an ARP request or an ARP Probe.
4.2. IPv6 Address Registration and Proxy Neighbor Discovery
so in this section, a Low-Power Wireless Personal Area Network (6LoWPAN) means a Low-Power and Lossy Network (LLN) that supports 6LoWPAN Header Compression (HC) [RFC6282] ๐ฆ. A 6TiSCH network [RFC9030] is an example of a 6LoWPAN.
to control IPv6 multicast over 6LoWPANs, the 6LoWPAN Neighbor Discovery (6LoWPAN ND) [RFC6775] standard defines an address registration mechanism. It relies on a central registry to check address uniqueness, which is a substitute for the inefficient DAD mechanism in the mainstream IPv6 Neighbor Discovery Protocol (NDP) [RFC4861] [RFC4862]. the vibes are very "less chaos, more organization" ๐ง
The 6lo Working Group has specified an update to [RFC6775]. Wireless devices can register their address to a Backbone Router [RFC8929], which proxies for the registered addresses with the IPv6 NDP running on a high-speed aggregating backbone. The update also enables a proxy registration mechanism on behalf of the Registered Node, e.g., by a 6LoWPAN router to which the mobile node is attached ๐ธ.
the general idea behind the Backbone Router concept is that broadcast and multicast messaging should be tightly controlled in a variety of WLANs and Wireless Personal Area Networks (WPANs) ๐. Connectivity to a particular link that provides the subnet should be left to Layer 3. The model for the Backbone Router operation is represented in Figure 1.
|
+-----+
| | Gateway (default) router
| |
+-----+
|
| Backbone Link
+--------------------+------------------+
| | |
+-----+ +-----+ +-----+
| | Backbone | | Backbone | | Backbone
| | router 1 | | router 2 | | router 3
+-----+ +-----+ +-----+
o o o o o o
o o o o o o o o o o o o o o
o o o o o o o o o o o o o o o
o o o o o o o o o o
o o o o o o o
LLN 1 LLN 2 LLN 3
Figure 1: Backbone Link and Backbone Routers
LLN nodes can move freely from an LLN anchored at one IPv6 Backbone Router to an LLN anchored at another Backbone Router on the same backbone, keeping any of the IPv6 addresses they have configured ๐โจ. The Backbone Routers maintain a Binding Table of their Registered Nodes, which serves as a distributed database of all the LLN nodes. An extension to the Neighbor Discovery Protocol is introduced to exchange Binding Table information across the Backbone Link as needed for the operation of IPv6 Neighbor Discovery.
[RFC6775] and follow-on work [RFC8505] address the needs of LLNs, and similar techniques are likely to be valuable on any type of link where sleeping devices are attached or where the use of broadcast and multicast operations should be limited ๐ฅบ.
4.3. Buffering to Improve Battery Life
okay battery life is a whole vibe ๐. Methods have been developed to help save it; for example, a device might not wake up when the AP receives a multicast packet. The AP acts on behalf of STAs in various ways. To enable use of the power-saving feature for STAs in its BSS, the AP buffers frames for delivery to the STA at the time when the STA is scheduled for reception. If an AP, for instance, expresses a Delivery Traffic Indication Message (DTIM) of 3, then the AP will send a multicast packet every 3 packets. In fact, when any single wireless STA associated with an AP has 802.11 power-save mode enabled, the AP buffers all multicast frames and sends them only after the next DTIM beacon.
in practice, most APs will send a multicast every 30 packets ๐. For unicast, the AP could send a Traffic Indication Message (TIM), but, for multicast, the AP sends a broadcast to everyone. DTIM does power management, but STAs can choose whether to wake up and whether to drop the packet. Unfortunately, without proper administrative control, such STAs may be unable to determine why their multicast operations do not work. the plot twist nobody asked for ๐
4.4. Limiting Multicast Buffer Hardware Queue Depth
the Content after Beacon (CAB) queue is used for beacon-triggered transmission of buffered multicast frames. If lots of multicast frames were buffered and this queue fills up, it drowns out all regular traffic ๐ญ. To limit the damage that buffered traffic can do, some drivers limit the amount of queued multicast data to a fraction of the beacon_interval. An example of this is [CAB] ๐ก๏ธ.
4.5. IPv6 Support in 802.11-2012
IPv6 uses NDP instead of ARP. Every IPv6 node subscribes to a special multicast address for this purpose ๐.
here's the spec language from clause 10.23.13 of [dot11-proxyarp], again, because it matters:
"When an IPv6 address is being resolved, the Proxy Neighbor Discovery service shall respond with a Neighbor Advertisement message [...] on behalf of an associated STA to an [ICMPv6] Neighbor Solicitation message [...]. When MAC address mappings change, the AP may send unsolicited Neighbor Advertisement Messages on behalf of a STA.
NDP may be used to request additional information using the following methods, among others:
- Maximum Transmission Unit
- Router Solicitation
- Router Advertisement
NDP messages are sent as group-addressed (broadcast) frames in 802.11. Using the proxy operation helps to keep NDP messages off the wireless medium ๐.
4.6. Using Unicast Instead of Multicast
it is often possible to transmit multicast control and data messages by using unicast transmissions to each station individually ๐.
4.6.1. Overview
in many situations, it's a good choice to use unicast instead of multicast over the Wi-Fi link ๐ซถ. This avoids most of the problems specific to multicast over Wi-Fi, since the individual frames are then acknowledged and buffered for power-save clients in the way that unicast traffic normally operates.
this approach comes with the trade-off of sometimes sending the same packet multiple times over the Wi-Fi link. However, in many cases, such as video into a residential home network, this can be a good trade-off, since the Wi-Fi link may have enough capacity for the unicast traffic to be transmitted to each subscribed STA, even though multicast addressing may have been necessary for the upstream access network โจ.
Several technologies exist that can be used to arrange unicast transport over the Wi-Fi link, outlined in the subsections below.
4.6.2. Layer 2 Conversion to Unicast
it is often possible to transmit multicast control and data messages by using unicast transmissions to each station individually (yes, I'm repeating it, it's that important ๐ค).
Although there is not yet a standardized method of conversion, at least one widely available implementation exists in the Linux bridging code [bridge-mc-2-uc]. Other proprietary implementations are available from various vendors. In general, these implementations perform a straightforward mapping for groups or channels, discovered by IGMP or MLD snooping, to the corresponding unicast MAC addresses ๐.
4.6.3. Directed Multicast Service (DMS)
DMS enables an STA to request that the AP transmit multicast group-addressed frames destined to the requesting STAs as individually addressed frames (i.e., convert multicast to unicast). Here are some characteristics of DMS:
- Requires 802.11n Aggregate MAC Service Data Units (A-MSDUs).
- Individually addressed frames are acknowledged and are buffered for power-save STAs.
- The requesting STA may specify traffic characteristics for DMS traffic.
- DMS was defined in IEEE Std 802.11v-2011 [v2011].
- DMS requires changes to both AP and STA implementation.
DMS is not currently implemented in products. See [Tramarin2017] and [Oliva2013] for more information ๐.
4.6.4. Automatic Multicast Tunneling (AMT)
AMT [RFC7450] provides a method to tunnel multicast IP packets inside unicast IP packets over network links that only support unicast. When an operating system or application running on an STA has an AMT gateway capability integrated, it's possible to use unicast to traverse the Wi-Fi link by deploying an AMT relay in the non-Wi-Fi portion of the network connected to the AP ๐ฆ.
it is recommended that multicast-enabled networks deploying AMT relays for this purpose make the relays locally discoverable with the following methods, as described in [RFC8777]:
- DNS-based Service Discovery (DNS-SD) [RFC6763]
- The well-known IP addresses from Section 7 of [RFC7450]
An AMT gateway that implements multiple standard discovery methods is more likely to discover the local multicast-capable network instead of forming a connection to a nonlocal AMT relay further upstream. that's the main character move, bestie ๐๐
4.7. GroupCast with Retries (GCR) โจ
Okay bestie, GCR (defined in [dot11aa]) is giving reliability ๐. It offers either unsolicited retries or a block acknowledgement mechanism, and it boosts the odds that a broadcast frame gets received successfully. It still doesn't guarantee success though ๐ฅบ.
For the block acknowledgement mechanism, the AP sends each group-addressed frame as a conventional group-addressed transmission. The retransmissions are also group addressed, but they're hidden from non-11aa STAs ๐. A directed block acknowledgement scheme harvests reception status from the receivers, and the retransmissions are based on those responses.
GCR is suitable for all group sizes, including medium to large groups ๐ซถ. As the group gets bigger, GCR can send block acknowledgement requests to only a small subset of the group. Just know that GCR does require changes to both AP and STA implementations ๐ ๏ธ.
GCR may introduce unacceptable latency ๐ญ. After sending a group of data frames to the group, the AP has to do the following:
- Unicast a Block Ack Request (BAR) to a subset of members.
- Wait for the corresponding Block Ack (BA).
- Retransmit any missed frames.
- Resume other operations that may have been delayed.
This latency may not be acceptable for some traffic ๐.
There are ongoing extensions in 802.11 to improve GCR performance ๐ฅ:
- BAR is sent using downlink Multi-User MIMO.
- BA is sent using uplink MU-MIMO (uplink MU-MIMO is an IEEE 801.11ax-2021 feature).
- Latency may also be reduced by simultaneously receiving BA information from multiple STAs.
5. Operational Optimizations ๐ธ
Okay so this section is all about operational optimizations you can actually put in place when you're deploying wireless IEEE 802 networks. The goal is to mitigate some of the issues we talked about in Section 3 ๐ฆ.
5.1. Mitigating Problems from Spurious Neighbor Discovery ๐ต๏ธโโ๏ธ
ARP Sponges
An ARP Sponge sits on a network and learns which IP addresses are actually in use. It also listens for ARP requests, and if it sees an ARP for an IP address it believes is not used, it replies with its own MAC address. This means the router now has an IP-to-MAC mapping, which it caches ๐งฝ. If that IP is later assigned to a machine (for example, using DHCP), the ARP Sponge sees this and stops replying for that address. Gratuitous ARPs (or the machine ARPing for its gateway) replace the sponged address in the router ARP table.
This technique is quite effective โจ. Unfortunately, the ARP Sponge daemons weren't really designed for this use. One of the most widely deployed ARP Sponges [arpsponge] was built to deal with participants disappearing from an Internet Exchange Point (IXP), so it isn't optimized for this purpose ๐ฌ. One daemon is needed per subnet, and the tuning is tricky (the scanning rate versus the population rate versus retries, etc.). Sometimes the daemons just stop, which requires restarting the daemon, and that restart causes disruption.
Router mitigations
Some routers (often those based on Linux) implement a "negative ARP cache" daemon. If the router doesn't see a reply to an ARP, it can be configured to cache this information for some interval ๐. Unfortunately, the core routers in use often don't support this. Instead, when a host connects to a network and gets an IP address, it ARPs for its default gateway (the router). The router then updates its cache with the IP-to-host MAC mapping learned from that request (passive ARP learning) ๐ฅ.
Firewall unused space
The distribution of users on wireless networks and subnets may change in various use cases, such as conference venues. For example, Service Set Identifiers (SSIDs) get renamed, and some SSIDs lose favor ๐ช. This makes utilization for particular SSIDs difficult to predict ahead of time, but usage can be monitored as attendees use the different networks ๐.
Configuring multiple DHCP pools per subnet and enabling them sequentially can create a large subnet from which only addresses in the lower portions are assigned ๐งฉ. Therefore, input IP access lists can be applied, which deny traffic to the upper, unused portions. Then the router doesn't attempt to forward packets to the unused portions of the subnets, and so it doesn't ARP for them. This method has proven to be very effective, but it's somewhat of a blunt axe ๐ช, it's fairly labor intensive, and it requires coordination.
Disabling/Filtering ARP requests
In general, the router doesn't need to ARP for hosts. When a host connects, the router can learn the IP-to-MAC mapping from the ARP request sent by that host. Consequently, it should be possible to disable and/or filter ARP requests from the router ๐ค. Unfortunately, ARP is a very low-level, fundamental part of the IP stack, and it's often offloaded from the normal control plane. While many routers can filter Layer 2 traffic, this is usually implemented as an input filter and/or has limited ability to filter output broadcast traffic. This means the seemingly simple and obvious solution to "just disable ARP or filter it outbound" gets made difficult or awkward in practice by implementations and/or architectural issues ๐ค.
NAT
Broadcasts can often be caused by outside Wi-Fi scanning and backscatter traffic ๐ก. To reduce the impact of broadcasts, NAT can be used on the entire network (or a large portion of it). This would eliminate NAT translation entries for unused addresses, and the router would never ARP for them. There are, however, many reasons to avoid using NAT in such a blanket fashion ๐ซ.
Stateful firewalls
Another obvious solution would be to put a stateful firewall between the wireless network and the Internet. This firewall would block incoming traffic not associated with an outbound request. But this conflicts with the need and desire of some organizations to keep the network as open as possible and to honor the end-to-end principle ๐๏ธ. An attendee on a meeting network should be an Internet host and should be able to receive unsolicited requests. Unfortunately, keeping the network working and stable is the first priority, and a stateful firewall may be required in order to achieve this ๐.
5.2. Mitigating Spurious Service Discovery Messages ๐ฃ
In networks that must support hundreds of STAs, operators have observed network degradation due to many devices simultaneously registering with mDNS ๐ตโ๐ซ. In a network with many clients, it is recommended to ensure that mDNS packets designed to discover services in smaller home networks are constrained, so they don't disrupt other traffic ๐งโโ๏ธ.
6. Multicast Considerations for Other Wireless Media ๐
Many of the causes of performance degradation described in earlier sections are also observable for wireless media other than 802.11 ๐ซ .
For instance, problems with power save, excess media occupancy, and poor reliability will also affect 802.15.3 and 802.15.4. Unfortunately, 802.15 media specifications don't yet include mechanisms similar to those developed for 802.11 ๐ฉ. In fact, the design philosophy for 802.15 is oriented towards minimality, with the result that many such functions are relegated to operation within higher-layer protocols. This leads to a patchwork of non-interoperable and vendor-specific solutions ๐งต. See [uli] for additional discussion and a proposal for a task group to resolve similar issues, in which the multicast problems might be considered for mitigation.
Similar considerations hold for most other wireless media. A brief introduction is provided in [RFC5757] for the following:
- 802.16 WiMAX
- 3GPP/3GPP2
- DVB-H/DVB-IPDC
- TV Broadcast and Satellite Networks
7. Recommendations ๐
This section provides some recommendations about the usage and combinations of some of the multicast enhancements described in Sections 4 and 5 ๐.
Future protocol documents utilizing multicast signaling should be carefully scrutinized if the protocol is likely to be used over wireless media ๐.
The use of proxy methods should be encouraged to conserve network bandwidth and power utilization by low-power devices ๐. The device can send a unicast message to its proxy, and then the proxy can take care of any needed multicast operations ๐ง.
Multicast signaling for wireless devices should be done in a way that is compatible with low duty-cycle operation ๐.
8. Ongoing Discussion Items ๐ง
This section suggests two discussion items for further resolution ๐ญ.
First, standards (and private) organizations should develop guidelines to help clarify when multicast packets would be better served by being sent wired rather than wireless ๐. For example, 802.1ak [IEEE802.1ak] works on both Ethernet and Wi-Fi, and organizations could help with deployment decision making by developing guidelines for multicast over Wi-Fi, including options for when traffic should be sent wired.
Second, reliable registration to Layer 2 multicast groups and a reliable multicast operation at Layer 2 might provide a good multicast over Wi-Fi solution ๐ฅฐ. There shouldn't be a need to support 2^24 groups to get solicited node multicast working. It is possible to simply select a number of bits that make sense for a given network size, which limits the number of unwanted deliveries to reasonable levels. The IEEE 802.1, 802.11, and 802.15 Working Groups should be encouraged to revisit Layer 2 multicast issues and provide workable solutions ๐.
9. Security Considerations ๐โจ
Okay bestie, this section is serious, so let's be serious for a sec ๐ . This document does not add or change any security mechanisms ๐ โโ๏ธ. That said, multicast on wired or wireless networks (the stuff this whole doc is about) can be made more secure in a bunch of ways ๐. For example, [RFC4601] says you can use IPsec to authenticate the link-local messages in the Protocol Independent Multicast - Sparse Mode (PIM-SM) routing protocol ๐ก๏ธ. And [RFC5796] lays out ways to authenticate those PIM-SM link-local messages using the IP security (IPsec) Encapsulating Security Payload (ESP) or, optionally, the Authentication Header (AH) ๐ซถ.
Now the spicy part ๐ถ๏ธ๐ญ. When you use mechanisms that turn multicast traffic into unicast traffic so it can cross radio links, the AP (or whatever other entity is doing it) is forced to explicitly keep track of which subscribers care about which multicast traffic ๐๐. Honestly, this is usually a reasonable trade-off ๐คทโโ๏ธ. But it does mean there's another entity keeping tabs on who subscribes to what ๐ต๏ธโโ๏ธ. That info is already tracked elsewhere (it has to be, by necessity), but this still expands the attack surface for information that could be privacy-sensitive ๐. Not okay, not okay ๐.
Next, [group_key] points out that multicast over wireless media is unreliable, and that can cause sneaky problems with multicast group key management and updates ๐๐ฌ. According to [group_key], when TKIP (WPA, now deprecated) or AES-CCMP (WPA2/WPA3) encryption is in use, AP-to-client (FromDS) multicasts have to be encrypted with a separate encryption key that every client knows. This is called the Group Key ๐๏ธโจ. And the website goes on to say, "... most clients are able to get connected and surf the web, check email, etc. even when FromDS multicasts are broken. So a lot of people don't realize they have multicast problems on their network..." ๐ญ Which is so relatable and so scary at the same time ๐.
This document encourages using proxy methods to save network bandwidth and power on low-power devices ๐๐ธ. The thing is, proxy methods generally come with security considerations, because the proxy has to be trusted to not misbehave ๐จ. One proxy method this doc lists is an ARP Sponge. It listens for ARP requests, and if it sees an ARP for an IP address it believes isn't used, it replies with its own MAC address ๐ง. Yikes. ARP poisoning and false advertising could potentially undermine this approach (and other proxy approaches too), for example through DoS ๐ฅ๐ฑ. Protect your proxies, babes ๐.
10. IANA Considerations ๐๐
This document has no IANA actions ๐ท. Nothing to register, nothing to update, nothing for IANA to do here, so we're chillin' ๐๐ฆ.
11. Informative References โจ
okay bestie, this is the reading list the authors used to back up everything above ๐ every entry is still here, word for word, so you can go find the originals yourself ๐
[arpsponge]Wessel, M. and N. Sijm, "Effects of IPv4 and IPv6 address resolution on AMS-IX and the ARP Sponge", July 2009, <http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.182.4692>.[bridge-mc-2-uc]"bridge: multicast to unicast", commit 6db6f0e, January 2017, <https://github.com/torvalds/linux/commit/6db6f0e>.[CAB]"limit multicast buffer hardware queue depth", commit 2687951, June 2013, <https://patchwork.kernel.org/patch/2687951/>.[Deri-2010]Deri, L. and J. Gasparakis, "10 Gbit Hardware Packet Filtering Using Commodity Network Adapters", RIPE 61, November 2010, <http://ripe61.ripe.net/presentations/138-Deri_RIPE_61.pdf>.[dot11]IEEE, "Information Technology--Telecommunications and Information Exchange between Systems - Local and Metropolitan Area Networks--Specific Requirements - Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications (includes 802.11v amendment)", DOI 10.1109/IEEESTD.2021.9363693, IEEE Std 802.11-2020, December 2020, <https://standards.ieee.org/standard/802_11-2020.html>.[dot11-proxyarp]Hiertz, G., Mestanov, F., and B. Hart, "Proxy ARP in 802.11ax", September 2015, <https://mentor.ieee.org/802.11/dcn/15/11-15-1015-01-00ax-proxy-arp-in-802-11ax.pptx>.[dot11aa]IEEE, "Information technology--Telecommunications and information exchange between systems Local and metropolitan area networks--Specific requirements Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications Amendment 2: MAC Enhancements for Robust Audio Video Streaming", DOI 10.1109/IEEESTD.2012.6204193, IEEE Std 802.11aa-2012, March 2012, <https://standards.ieee.org/standard/802_11aa-2012.html>.[group_key]"Subject: Why do some WiFi routers block multicast packets going from wired to wireless?", message to the Super User Q & A community, January 2017, <https://superuser.com/questions/730288/why-do-some-wifi-routers-block-multicast-packets-going-from-wired-to-wireless>.[IEEE802.1ak]IEEE, "Local and Metropolitan Area Networks Virtual Bridged Local Area Networks - Amendment 07: Multiple Registration Protocol", DOI 10.1109/IEEESTD.2007.380667, IEEE Std 802.1ak-2007, June 2007, <https://www.ieee802.org/1/pages/802.1ak.html>.[ietf_802-11]Stanley, D., "IEEE 802.11 multicast capabilities", November 2015, <https://mentor.ieee.org/802.11/dcn/15/11-15-1261-03-0arc-multicast-performance-optimization-features-overview-for-ietf-nov-2015.ppt>.[mc-prob-stmt]Abrahamsson, M. and A. Stephens, "Multicast on 802.11", 2013, <https://www.iab.org/wp-content/IAB-uploads/2013/01/multicast-problem-statement.pptx>.[mc-props]Stephens, A., "IEEE 802.11 multicast properties", September 2015, <https://mentor.ieee.org/802.11/dcn/15/11-15-1161-02-0arc-802-11-multicast-properties.ppt>.[Oliva2013]de la Oliva, A., Serrano, P., Salvador, P., and A. Banchs, "Performance evaluation of the IEEE 802.11aa multicast mechanisms for video streaming", 2013 IEEE 14th International Symposium on "A World of Wireless, Mobile and Multimedia Networks" (WoWMoM), pp. 1-9, DOI 10.1109/WoWMoM.2013.6583394, June 2013, <https://doi.org/10.1109/WoWMoM.2013.6583394>.[RFC0826]Plummer, D., "An Ethernet Address Resolution Protocol: Or Converting Network Protocol Addresses to 48.bit Ethernet Address for Transmission on Ethernet Hardware", STD 37, RFC 826, DOI 10.17487/RFC0826, November 1982, <https://www.rfc-editor.org/info/rfc826>.[RFC2131]Droms, R., "Dynamic Host Configuration Protocol", RFC 2131, DOI 10.17487/RFC2131, March 1997, <https://www.rfc-editor.org/info/rfc2131>.[RFC4286]Haberman, B. and J. Martin, "Multicast Router Discovery", RFC 4286, DOI 10.17487/RFC4286, December 2005, <https://www.rfc-editor.org/info/rfc4286>.[RFC4541]Christensen, M., Kimball, K., and F. Solensky, "Considerations for Internet Group Management Protocol (IGMP) and Multicast Listener Discovery (MLD) Snooping Switches", RFC 4541, DOI 10.17487/RFC4541, May 2006, <https://www.rfc-editor.org/info/rfc4541>.[RFC4601]Fenner, B., Handley, M., Holbrook, H., and I. Kouvelas, "Protocol Independent Multicast - Sparse Mode (PIM-SM): Protocol Specification (Revised)", RFC 4601, DOI 10.17487/RFC4601, August 2006, <https://www.rfc-editor.org/info/rfc4601>.[RFC4861]Narten, T., Nordmark, E., Simpson, W., and H. Soliman, "Neighbor Discovery for IP version 6 (IPv6)", RFC 4861, DOI 10.17487/RFC4861, September 2007, <https://www.rfc-editor.org/info/rfc4861>.[RFC4862]Thomson, S., Narten, T., and T. Jinmei, "IPv6 Stateless Address Autoconfiguration", RFC 4862, DOI 10.17487/RFC4862, September 2007, <https://www.rfc-editor.org/info/rfc4862>.[RFC5757]Schmidt, T., Waehlisch, M., and G. Fairhurst, "Multicast Mobility in Mobile IP Version 6 (MIPv6): Problem Statement and Brief Survey", RFC 5757, DOI 10.17487/RFC5757, February 2010, <https://www.rfc-editor.org/info/rfc5757>.[RFC5796]Atwood, W., Islam, S., and M. Siami, "Authentication and Confidentiality in Protocol Independent Multicast Sparse Mode (PIM-SM) Link-Local Messages", RFC 5796, DOI 10.17487/RFC5796, March 2010, <https://www.rfc-editor.org/info/rfc5796>.[RFC6282]Hui, J., Ed. and P. Thubert, "Compression Format for IPv6 Datagrams over IEEE 802.15.4-Based Networks", RFC 6282, DOI 10.17487/RFC6282, September 2011, <https://www.rfc-editor.org/info/rfc6282>.[RFC6762]Cheshire, S. and M. Krochmal, "Multicast DNS", RFC 6762, DOI 10.17487/RFC6762, February 2013, <https://www.rfc-editor.org/info/rfc6762>.[RFC6763]Cheshire, S. and M. Krochmal, "DNS-Based Service Discovery", RFC 6763, DOI 10.17487/RFC6763, February 2013, <https://www.rfc-editor.org/info/rfc6763>.[RFC6775]Shelby, Z., Ed., Chakrabarti, S., Nordmark, E., and C. Bormann, "Neighbor Discovery Optimization for IPv6 over Low-Power Wireless Personal Area Networks (6LoWPANs)", RFC 6775, DOI 10.17487/RFC6775, November 2012, <https://www.rfc-editor.org/info/rfc6775>.[RFC6970]Boucadair, M., Penno, R., and D. Wing, "Universal Plug and Play (UPnP) Internet Gateway Device - Port Control Protocol Interworking Function (IGD-PCP IWF)", RFC 6970, DOI 10.17487/RFC6970, July 2013, <https://www.rfc-editor.org/info/rfc6970>.[RFC7450]Bumgardner, G., "Automatic Multicast Tunneling", RFC 7450, DOI 10.17487/RFC7450, February 2015, <https://www.rfc-editor.org/info/rfc7450>.[RFC7761]Fenner, B., Handley, M., Holbrook, H., Kouvelas, I., Parekh, R., Zhang, Z., and L. Zheng, "Protocol Independent Multicast - Sparse Mode (PIM-SM): Protocol Specification (Revised)", STD 83, RFC 7761, DOI 10.17487/RFC7761, March 2016, <https://www.rfc-editor.org/info/rfc7761>.[RFC8415]Mrugalski, T., Siodelski, M., Volz, B., Yourtchenko, A., Richardson, M., Jiang, S., Lemon, T., and T. Winters, "Dynamic Host Configuration Protocol for IPv6 (DHCPv6)", RFC 8415, DOI 10.17487/RFC8415, November 2018, <https://www.rfc-editor.org/info/rfc8415>.[RFC8505]Thubert, P., Ed., Nordmark, E., Chakrabarti, S., and C. Perkins, "Registration Extensions for IPv6 over Low-Power Wireless Personal Area Network (6LoWPAN) Neighbor Discovery", RFC 8505, DOI 10.17487/RFC8505, November 2018, <https://www.rfc-editor.org/info/rfc8505>.[RFC8777]Holland, J., "DNS Reverse IP Automatic Multicast Tunneling (AMT) Discovery", RFC 8777, DOI 10.17487/RFC8777, April 2020, <https://www.rfc-editor.org/info/rfc8777>.[RFC8929]Thubert, P., Ed., Perkins, C.E., and E. Levy-Abegnoli, "IPv6 Backbone Router", RFC 8929, DOI 10.17487/RFC8929, November 2020, <https://www.rfc-editor.org/info/rfc8929>.[RFC9030]Thubert, P., Ed., "An Architecture for IPv6 over the Time-Slotted Channel Hopping Mode of IEEE 802.15.4 (6TiSCH)", RFC 9030, DOI 10.17487/RFC9030, May 2021, <https://www.rfc-editor.org/info/rfc9030>.[Tramarin2017]Tramarin, F., Vitturi, S., and M. Luvisotto, "IEEE 802.11n for Distributed Measurement Systems", 2017 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), pp. 1-6, May 2017.[uli]Kinney, P., "LLC Proposal for 802.15.4", September 2015, <https://mentor.ieee.org/802.15/dcn/15/15-15-0521-01-wng0-llc-proposal-for-802-15-4.pptx>.[v2011]IEEE, "Information technology -- Local and metropolitan area networks -- Specific requirements -- Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) specifications Amendment 8: IEEE 802.11 Wireless Network Management", DOI 10.1109/IEEESTD.2011.5716530, IEEE Std 802.11v-2011, February 2011, <https://ieeexplore.ieee.org/document/5716530>.
Acknowledgements ๐ซถ
big thank-yous to the people who talked this through with the authors ๐ (listed in alphabetical order, obviously): Mikael Abrahamsson, Bill Atwood, Stuart Cheshire, Donald Eastlake 3rd, Toerless Eckert, Jake Holland, Joel Jaeggli, Jan Komissar, David Lamparter, Morten Pedersen, Pascal Thubert, and Jeffrey (Zhaohui) Zhang. literal legends ๐
Authors' Addresses ๐ฆ
Here are the authors' contact details, exactly as written:
Charles E. Perkins
Lupin Lodge
Phone: +1 408 255 9223
Email: charliep@lupinlodge.com
Mike McBride
Futurewei Technologies Inc.
2330 Central Expressway
Santa Clara, CA 95055
United States of America
Email: michael.mcbride@futurewei.com
Dorothy Stanley
Hewlett Packard Enterprise
6280 America Center Dr.
San Jose, CA 95002
United States of America
Phone: +1 630 363 1389
Email: dorothy.stanley@hpe.com
Warren Kumari
Google
1600 Amphitheatre Parkway
Mountain View, CA 94043
United States of America
Email: warren@kumari.net
Juan Carlos Zรบรฑiga
SIGFOX
Montreal
Canada
Email: j.c.zuniga@ieee.org
๐ฆ where this page comes from
- ietf: rfc9119 2021-10
- ๐ girlified by claude-haiku-5-5 on : a language model's rewrite of the original, under its terms