fi_lpp(7)

πŸ’– NAME: fi_lpp(7) β€” The LPP Fabric Provider πŸ’–

Bestie, this is fi_lpp(7), aka The LPP Fabric Provider. That's the name, that's the page, and we're already off to a slay. 🫢


🌈 OVERVIEW 🌈

Okay so the LPP provider runs on FabreX PCIe networks. FabreX provides high performance RDMA capabilities which form the foundation of the LPP provider. Higher level primitives are implemented at the libfabric and LPP kernel module (KLPP) layers. It's giving layered, it's giving foundational, it's giving exactly what the page says. ✨


✨ SUPPORTED FEATURES ✨

The LPP provider supports a subset of the libfabric API. Key features include:

πŸŽ€ Endpoint types πŸŽ€

LPP supports the FI_EP_RDM endpoint type with resource management. That's the endpoint type, and resource management is coming with it. πŸ’…

πŸŽ€ Endpoint capabilities πŸŽ€

LPP supports FI_MSG, FI_RMA, and FI_TAGGED message types. Message types? Supported. Periodt. πŸ’Œ

πŸŽ€ Additional capabilities πŸŽ€

LPP supports the additional features: FI_DIRECTED_RECV, FI_MULTI_RECV, FI_INJECT, FI_DELIVERY_COMPLETE. Look at that list, bestie β€” additional capabilities ate. πŸ”₯

πŸŽ€ Progress πŸŽ€

LPP currently supports only FI_PROGRESS_MANUAL. Therefore user applications are required to poll for progress. So yeah, polling is the assignment. πŸ“ˆ


πŸ’€ LIMITATIONS πŸ’€

Vibe check: these features are unsupported β€” connection management, event queue, scalable endpoint, passive endpoint, shared receive context, atomics. Not here, not on this provider, not today. 😭

🧚 RUNTIME PARAMETERS 🧚

The LPP provider checks for the following environment variables:

  • FI_LPP_DISABLE_OSBYPASS β€” A bool which disables direct userspace writes when set. This can be used as a debugging aid, however it will degrade performance. So like, debug if you must, but highkey it will degrade performance. πŸ™ˆ
  • FI_LPP_MAX_WR_OSBYPASS_SIZE β€” Sets the maximum size for PIO when performing write RDMA transfers. Transfers at or below this size will use CPU copy, while transfers above it will use a DMA engine. Cutoff behavior, very demure, very PIO. πŸŽ€
  • FI_LPP_MAX_RD_OSBYPASS_SIZE β€” Sets the maximum size for PIO when performing read RDMA transfers. Transfers at or below this size will use CPU copy, while transfers above it will use a DMA engine. Same energy, read-RDMA edition. πŸ¦‹
  • FI_LPP_CQ_OVERCOMMIT β€” A bool which allows operations to start that may overrun the CQ. Normally, when resource management is enabled, the LPP provider will attempt to throttle operations that might overrun the CQ. This parameter disables that behavior while leaving the remainder of the resource management features enabled. So it's not "resource management off," it's "that throttling behavior off, remainder still enabled." πŸ’…
  • FI_LPP_DOMAIN_CLEANUP β€” A bool which controls whether closing a domain with active resources will cause those resources to be automatically closed. If true (the default), the LPP provider will automatically close the resources. Default is true, so auto-close is the default vibe. ✨
  • FI_LPP_SYSTEM_MEMCPY β€” Use the memcpy implementation in the system libc rather than provider-specific memcpy. System libc vs provider-specific memcpy: choose your fighter. 🫢

πŸ“š SEE ALSO πŸ“š

Required reading, bestie. Go click through the manuals. πŸ’–


πŸ‘‘ AUTHORS πŸ‘‘

OpenFabrics. Iconic. πŸ‘‘


This cutie came from Libfabric v2.5.1, Libfabric Programmer’s Manual, dated 2024-12-10. Bye bestie, mwah! πŸ’‹πŸ¦‹

πŸ“¦ where this page comes from