SHM_OPEN(3P)

๐Ÿ’– SHM_OPEN(3P) โ€” POSIX Programmer's Manual ๐Ÿ’–

๐ŸŒธ PROLOG ๐ŸŒธ

okay so, real talk: this manual page is part of the POSIX Programmer's Manual. The Linux implementation of this interface may differ (consult the corresponding Linux manual page for details of Linux behavior), or the interface may not be implemented on Linux. iykyk ๐Ÿ’…

โœจ NAME โœจ

shm_open โ€” open a shared memory object (REALTIME). It's giving "let's connect a shared memory object to a file descriptor" energy. ๐Ÿซถ

๐Ÿ“œ SYNOPSIS ๐Ÿ“œ

#include <sys/mman.h>

int shm_open(const char *name, int oflag, mode_t mode);

๐Ÿ’ซ DESCRIPTION ๐Ÿ’ซ

The shm_open() function shall establish a connection between a shared memory object and a file descriptor. It shall create an open file description that refers to the shared memory object and a file descriptor that refers to that open file description. The file descriptor shall be allocated as described in Section 2.14, File Descriptor Allocation, and can be used by other functions to refer to that shared memory object. no cap, it's literally the link between your process and the shared memory object.

The name argument points to a string naming a shared memory object. It is unspecified whether the name appears in the file system and is visible to other functions that take pathnames as arguments. The name argument conforms to the construction rules for a pathname, except that the interpretation of <slash> characters other than the leading <slash> character in name is implementation-defined, and that the length limits for the name argument are implementation-defined and need not be the same as the pathname limits {PATH_MAX} and {NAME_MAX}. If name begins with the <slash> character, then processes calling shm_open() with the same value of name refer to the same shared memory object, as long as that name has not been removed. If name does not begin with the <slash> character, the effect is implementation-defined. so yes, leading slash matters, bestie. don't play yourself.

If successful, shm_open() shall return a file descriptor for the shared memory object. The open file description is new, and therefore the file descriptor does not share it with any other processes. It is unspecified whether the file offset is set. The FD_CLOEXEC file descriptor flag associated with the new file descriptor is set. set that close-on-exec, periodt.

The file status flags and file access modes of the open file description are according to the value of oflag. The oflag argument is the bitwise-inclusive OR of the following flags defined in the <fcntl.h> header. Applications specify exactly one of the first two values (access modes) below in the value of oflag:

  • O_RDONLY โ€” Open for read access only. ๐Ÿ‘€
  • O_RDWR โ€” Open for read or write access. โœ๏ธ

Any combination of the remaining flags may be specified in the value of oflag:

  • O_CREAT โ€” If the shared memory object exists, this flag has no effect, except as noted under O_EXCL below. Otherwise, the shared memory object is created. The user ID of the shared memory object shall be set to the effective user ID of the process. The group ID of the shared memory object shall be set to the effective group ID of the process; however, if the name argument is visible in the file system, the group ID may be set to the group ID of the containing directory. The permission bits of the shared memory object shall be set to the value of the mode argument except those set in the file mode creation mask of the process. When bits in mode other than the file permission bits are set, the effect is unspecified. The mode argument does not affect whether the shared memory object is opened for reading, for writing, or for both. The shared memory object has a size of zero. ๐ŸŽ€ fresh object, zero bytes, new you.
  • O_EXCL โ€” If O_EXCL and O_CREAT are set, shm_open() fails if the shared memory object exists. The check for the existence of the shared memory object and the creation of the object if it does not exist is atomic with respect to other processes executing shm_open() naming the same shared memory object with O_EXCL and O_CREAT set. If O_EXCL is set and O_CREAT is not set, the result is undefined. ๐Ÿ’€ undefined behavior alert! don't do that.
  • O_TRUNC โ€” If the shared memory object exists, and it is successfully opened O_RDWR, the object shall be truncated to zero length and the mode and owner shall be unchanged by this function call. The result of using O_TRUNC with O_RDONLY is undefined. also undefined with O_RDONLY, bestie. put the scissors down.

When a shared memory object is created, the state of the shared memory object, including all data associated with the shared memory object, persists until the shared memory object is unlinked and all other references are gone. It is unspecified whether the name and shared memory object state remain valid after a system reboot. so it's not just a vibe, it's persistence.

๐Ÿ”™ RETURN VALUE ๐Ÿ”™

Upon successful completion, the shm_open() function shall return a non-negative integer representing the file descriptor. Otherwise, it shall return -1 and set errno to indicate the error. classic.

๐Ÿšจ ERRORS ๐Ÿšจ

The shm_open() function shall fail if:

  • EACCES โ€” The shared memory object exists and the permissions specified by oflag are denied, or the shared memory object does not exist and permission to create the shared memory object is denied, or O_TRUNC is specified and write permission is denied.
  • EEXIST โ€” O_CREAT and O_EXCL are set and the named shared memory object already exists.
  • EINTR โ€” The shm_open() operation was interrupted by a signal.
  • EINVAL โ€” The shm_open() operation is not supported for the given name.
  • EMFILE โ€” All file descriptors available to the process are currently open.
  • ENFILE โ€” Too many shared memory objects are currently open in the system.
  • ENOENT โ€” O_CREAT is not set and the named shared memory object does not exist.
  • ENOSPC โ€” There is insufficient space for the creation of the new shared memory object.

The shm_open() function may fail if:

  • ENAMETOOLONG โ€” The length of the name argument exceeds {_POSIX_PATH_MAX} on systems that do not support the XSI option or exceeds {_XOPEN_PATH_MAX} on XSI systems, or has a pathname component that is longer than {_POSIX_NAME_MAX} on systems that do not support the XSI option or longer than {_XOPEN_NAME_MAX} on XSI systems.

The following sections are informative.

๐ŸŽ€ EXAMPLES ๐ŸŽ€

๐Ÿฆ‹ Creating and Mapping a Shared Memory Object ๐Ÿฆ‹

The following code segment demonstrates the use of shm_open() to create a shared memory object which is then sized using ftruncate() before being mapped into the process address space using mmap():

#include <unistd.h>
#include <sys/mman.h>
...

#define MAX_LEN 10000
struct region {        /* Defines "structure" of shared memory */
    int len;
    char buf[MAX_LEN];
};
struct region *rptr;
int fd;

/* Create shared memory object and set its size */

fd = shm_open("/myregion", O_CREAT | O_RDWR, S_IRUSR | S_IWUSR);
if (fd == -1)
    /* Handle error */;

if (ftruncate(fd, sizeof(struct region)) == -1)
    /* Handle error */;

/* Map shared memory object */

rptr = mmap(NULL, sizeof(struct region),
       PROT_READ | PROT_WRITE, MAP_SHARED, fd, 0);
if (rptr == MAP_FAILED)
    /* Handle error */;

/* Now we can refer to mapped region using fields of rptr;
   for example, rptr->len */
...

๐ŸŒˆ APPLICATION USAGE ๐ŸŒˆ

None. that's it, that's the section. slay.

๐Ÿ’ญ RATIONALE ๐Ÿ’ญ

Okay bestie, gather round, because this is the why of it all and it's actually so interesting, I promise. โœจ

When the Memory Mapped Files option is supported, you just use a normal open() call to get a descriptor to a file you're gonna map, exactly like the existing practice with mmap(). But when the Shared Memory Objects option is supported? That's when shm_open() steps in to get you a descriptor to the shared memory object that's gonna get mapped. Two doors, same destination vibe. ๐Ÿšชโœจ

There is, like, ample precedent for one file descriptor representing several types of objects. In the POSIX.1โ€1990 standard, a file descriptor can represent a file, a pipe, a FIFO, a tty, or a directory. Not me being a multi-hyphenate. ๐Ÿ’… Many implementations just have an operations vector that's indexed by the file descriptor type and does very different operations depending on what it is. And note โ€” in some cases the file descriptor passed to generic operations on file descriptors is returned by open() or creat(), and in some cases it's returned by alternate functions, such as pipe(). That second technique? That's the one shm_open() uses. Iconic.

Also real talk: those shared memory objects can actually be implemented as mapped files. Either way, the size gets set after the open using ftruncate(). And shm_open() itself does not create a shared object of a specified size, because that would just be duplicating an extant function that sets the size of an object referenced by a file descriptor. We don't do redundant here. ๐Ÿ™…โ€โ™€๏ธ

On implementations where memory objects are implemented using the existing file system, shm_open() may be implemented using a macro that invokes open(), and shm_unlink() may be implemented using a macro that invokes unlink(). Sneaky. Love that for them.

For implementations without a permanent file system, the definition of the name of the memory objects is allowed not to survive a system reboot. And heads up โ€” that also means systems with a permanent file system are allowed to implement memory objects as data structures internal to the implementation. Flexible queen. ๐Ÿ‘‘

On implementations that choose to implement memory objects using memory directly, a shm_open() followed by an ftruncate() and close() can be used to preallocate a shared memory area and set the size of that preallocation. This may be necessary for systems without virtual memory hardware support, so they can make sure the memory is contiguous. Necessary, not optional, bestie.

The set of valid open flags to shm_open() was restricted to O_RDONLY, O_RDWR, O_CREAT, and O_TRUNC because these could be easily implemented on most memory mapping systems. And this volume of POSIX.1โ€2017 is silent on the results if the implementation cannot supply the requested file access because of implementation-defined reasons, including hardware ones. Silent. Like it's giving you nothing. ๐Ÿ˜ถ

The error conditions [EACCES] and [ENOTSUP] are provided to inform the application that the implementation cannot complete a request. So thoughtful of them to tell us instead of just ghosting. ๐Ÿซถ

  • [EACCES] โ€” indicates, for implementation-defined reasons (probably hardware-related), that the implementation cannot comply with a requested mode because it conflicts with another requested mode. Example time: an application wants to open a memory object two times, mapping different areas with different access modes. If the implementation cannot map a single area into a process space in two places โ€” which would be required if different access modes were needed for the two areas โ€” then the implementation may inform the application at the time of the second open. Caught at the second one, not the first. ๐Ÿ”
  • [ENOTSUP] โ€” indicates, for implementation-defined reasons (probably hardware-related), that the implementation cannot comply with a requested mode at all. Example: the hardware of the implementation cannot support write-only shared memory areas. Not a conflict, just a straight-up no. ๐Ÿ’€

On all implementations, it may be desirable to restrict the location of the memory objects to specific file systems โ€” for performance (such as a RAM disk) or for implementation-defined reasons (shared memory supported directly only on certain file systems). And shm_open() may be used to enforce these restrictions. There are a number of methods available to the application to determine an appropriate name of the file or the location of an appropriate directory. One way is from the environment via getenv(). Another would be from a configuration file. Pick your fighter. ๐ŸŒˆ

This volume of POSIX.1โ€2017 specifies that memory objects have initial contents of zero when created. Why? Because it's consistent with current behavior for both files and newly allocated memory. For those implementations that use physical memory, it would be possible that such implementations could simply use available memory and give it to the process uninitialized. But that's not consistent with standard behavior for the uninitialized data area, the stack, and of course, files. And finally โ€” and this is the big one โ€” it is highly desirable to set the allocated memory to zero for security reasons. So yeah. Initializing memory objects to zero is required. No debate. ๐Ÿ”โœจ


๐Ÿ”ฎ FUTURE DIRECTIONS ๐Ÿ”ฎ

A future version might require the shm_open() and shm_unlink() functions to have semantics similar to normal file system operations. Manifesting. ๐Ÿ•ฏ๏ธ


๐Ÿ‘€ SEE ALSO ๐Ÿ‘€

  • Section 2.14, File Descriptor Allocation
  • close()
  • dup()
  • exec
  • fcntl()
  • mmap()
  • shmat()
  • shmctl()
  • shmdt()
  • shm_unlink()
  • umask()

The Base Definitions volume of POSIX.1โ€2017, <fcntl.h>, <sys_mman.h>


Portions of this text are reprinted and reproduced in electronic form from IEEE Std 1003.1-2017, Standard for Information Technology -- Portable Operating System Interface (POSIX), The Open Group Base Specifications Issue 7, 2018 Edition, Copyright (C) 2018 by the Institute of Electrical and Electronics Engineers, Inc and The Open Group. In the event of any discrepancy between this version and the original IEEE and The Open Group Standard, the original IEEE and The Open Group Standard is the referee document. The original Standard can be obtained online at http://www.opengroup.org/unix/online.html .

Any typographical or formatting errors that appear in this page are most likely to have been introduced during the conversion of the source files to man page format. To report such errors, see https://www.kernel.org/doc/man-pages/reporting_bugs.html .


And that's a wrap on SHM_OPEN(3P), bestie! ๐ŸŽ€ This one's from IEEE/The Open Group, dated 2017 โ€” the source and version and date, all accounted for, no cap. Go forth and map some shared memory. You ate. ๐Ÿ’…โœจ๐Ÿฆ‹
๐Ÿ“ฆ where this page comes from