LIBUV(1)
๐ libuv(1) โ libuv API documentation ๐
okay so bestie, you're looking at the libuv manual page, aka libuv(1), aka the libuv API documentation. It's giving foundational async energy, and we're gonna get through it together. ๐ซถ
๐ NAME ๐
libuv โ libuv documentation. That's the name, that's the vibe, iconic. ๐
โจ OVERVIEW โจ
libuv is a multi-platform support library with a focus on asynchronous I/O. It was primarily developed for use by Node.js (https://nodejs.org), but it's also used by Luvit (https://luvit.io), Julia (https://julialang.org), uvloop (https://github.com/MagicStack/uvloop), and others (https://github.com/libuv/libuv/blob/v1.x/LINKS.md). no cap, the ecosystem said "we stan." ๐
Note: In case you find errors in this documentation you can help by sending pull requests (https://github.com/libuv/libuv)! bestie behavior fr fr. ๐
๐ฆ FEATURES ๐ฆ
- Full-featured event loop backed by
epoll,kqueue,IOCP, event ports. ๐ฅ - Asynchronous TCP and UDP sockets.
- Asynchronous DNS resolution.
- Asynchronous file and file system operations.
- File system events.
- ANSI escape code controlled TTY.
- IPC with socket sharing, using Unix domain sockets or named pipes (Windows).
- Child processes.
- Thread pool.
- Signal handling.
- High resolution clock.
- Threading and synchronization primitives.
๐ธ DOCUMENTATION ๐ธ
๐ Design overview ๐
libuv is a cross-platform support library which was originally written for Node.js (https://nodejs.org). It's designed around the event-driven asynchronous I/O model. ๐ซ
The library provides much more than a simple abstraction over different I/O polling mechanisms: 'handles' and 'streams' provide a high level abstraction for sockets and other entities; cross-platform file I/O and threading functionality is also provided, amongst other things. it's giving range, honestly.
Here is a diagram illustrating the different parts that compose libuv and what subsystem they relate to:
LIBUV
+----------------------------------------------+ +---+ +---+ +---+
| | | | | | | |
| Network I/O | | F | | D | | U |
| | | i | | N | | s |
| | | l | | S | | e |
| | | e | | | | r |
| | | | | O | | |
| | | I | | p | | C |
| +------+ +------+ +------+ +------+ +------+ | | / | | s | | o |
| | TCP | | UDP | | TTY | | Pipe | | ... | | | O | | | | d |
| +------+ +------+ +------+ +------+ +------+ | | | | | | e |
| | | | | | | |
+----------------------------------------------+ +---+ +---+ +---+
+----------------------------------+ +--------+ +---------------+
| uv__io_t | | | | |
+----------------------------------+ | | | |
| IOCP | | Thread Pool |
+-------+ +--------+ +-------------+ | | | |
| epoll | | kqueue | | event ports | | | | |
+-------+ +--------+ +-------------+ +--------+ +---------------+
๐ Handles and requests ๐
libuv provides users with 2 abstractions to work with, in combination with the event loop: handles and requests. yes bestie, only two, and they're both main characters. ๐
Handles represent long-lived objects capable of performing certain operations while active. Some examples:
- A prepare handle gets its callback called once every loop iteration when active.
- A TCP server handle that gets its connection callback called every time there is a new connection.
Requests represent (typically) short-lived operations. These operations can be performed over a handle: write requests are used to write data on a handle; or standalone: getaddrinfo requests don't need a handle they run directly on the loop.
Guidelines for dealing with handles and requests:
- If
uv_foo_init()succeeds in initializing the handle, you must calluv_close(). If the handle's init function errors, you don't need to do anything. - Only handles are closed, not requests. For example,
uv_tcp_tis a handle,uv_write_tis a request. - The handle's memory can only be reclaimed or reused from inside the
uv_close_cbor afterwards, not before. - Most handles have init + start/stop functions; some handles don't. Example:
uv_tcp_tvs.uv_process_t;uv_spawn()combines handle initialization and process start into one. - Requests are closed automatically when they complete, or when they are cancelled with
uv_cancel(). - No additional cleanup is needed except for
uv_fs_tanduv_getaddrinfo_trequests. Foruv_fs_t, calluv_fs_req_cleanup()once you are done with it; foruv_getaddrinfo_t, that'suv_freeaddrinfo(). - The request's memory can only be reclaimed or reused from that point onward.
๐ฅ The I/O loop ๐ฅ
The I/O (or event) loop is the central part of libuv. It establishes the content for all I/O operations, and it's meant to be tied to a single thread. One can run multiple event loops as long as each runs in a different thread. The libuv event loop (or any other API involving the loop or handles, for that matter) is not thread-safe except where stated otherwise. โ ๏ธ
The event loop follows the rather usual single threaded asynchronous I/O approach: all (network) I/O is performed on non-blocking sockets which are polled using the best mechanism available on the given platform: epoll on Linux, kqueue on OSX and other BSDs, event ports on SunOS and IOCP on Windows. As part of a loop iteration the loop will block waiting for I/O activity on sockets which have been added to the poller and callbacks will be fired indicating socket conditions (readable, writable hangup) so handles can read, write or perform the desired I/O operation.
In order to better understand how the event loop operates, the following diagram illustrates all stages of a loop iteration:
+------------------------+
| Initialze loop time |
+------------------------+
| Run due timers |
+------------------------+
|
v
__
_____ / \
/ \ / \
/ \ No / Loop \
| end |<-------| alive? |<----------+
\ / \ / |
\ / \ / |
----- \__/ |
| |
| Yes |
v |
+------------------------+ |
| Call pending callbacks | |
+------------------------+ |
| Run idle handles | |
+------------------------+ |
| Run prepare handles | |
+------------------------+ |
| Poll for I/O | |
+------------------------+ |
| Run check handles | |
+------------------------+ |
| Call close callbacks | |
+------------------------+ |
| Update loop time | |
+------------------------+ |
| Run due timers |---+
+------------------------+
- The loop concept of 'now' is initially set.
- Due timers are run if the loop was run with
UV_RUN_DEFAULT. All active timers scheduled for a time before the loop's concept of now get their callbacks called. - If the loop is alive an iteration is started, otherwise the loop will exit immediately. So, when is a loop considered to be alive? If a loop has active and ref'd handles, active requests or closing handles it's considered to be alive.
- Pending callbacks are called. All I/O callbacks are called right after polling for I/O, for the most part. There are cases, however, in which calling such a callback is deferred for the next loop iteration. If the previous iteration deferred any I/O callback it will be run at this point.
- Idle handle callbacks are called. Despite the unfortunate name, idle handles are run on every loop iteration, if they are active.
- Prepare handle callbacks are called. Prepare handles get their callbacks called right before the loop will block for I/O.
- Poll timeout is calculated. Before blocking for I/O the loop calculates for how long it should block. These are the rules when calculating the timeout:
- If the loop was run with the
UV_RUN_NOWAITflag, the timeout is 0. - If the loop is going to be stopped (
uv_stop()was called), the timeout is 0. - If there are no active handles or requests, the timeout is 0.
- If there are any idle handles active, the timeout is 0.
- If there are any handles pending to be closed, the timeout is 0.
- If none of the above cases matches, the timeout of the closest timer is taken, or if there are no active timers, infinity.
- If the loop was run with the
- The loop blocks for I/O. At this point the loop will block for I/O for the duration calculated in the previous step. All I/O related handles that were monitoring a given file descriptor for a read or write operation get their callbacks called at this point.
- Check handle callbacks are called. Check handles get their callbacks called right after the loop has blocked for I/O. Check handles are essentially the counterpart of prepare handles.
- Close callbacks are called. If a handle was closed by calling
uv_close()it will get the close callback called. - The loop concept of 'now' is updated.
- Due timers are run. Note that 'now' is not updated again until the next loop iteration. So if a timer became due while other timers were being processed, it won't be run until the following event loop iteration.
- Iteration ends. If the loop was run with
UV_RUN_NOWAITorUV_RUN_ONCEmodes the iteration ends anduv_run()will return. If the loop was run withUV_RUN_DEFAULTit will continue from the start if it's still alive, otherwise it will also end.
Important: libuv uses a thread pool to make asynchronous file I/O operations possible, but network I/O is always performed in a single thread, each loop's thread. this part matters, bestie, don't skip it. ๐ซถ
Note: the polling mechanism is different, but libuv keeps the execution model consistent across Unix systems and Windows. Same vibe, different plumbing ๐
๐ธ File I/O
Okay so here's the thing โ network I/O has all these cute platform-specific primitives libuv can lean on, but file I/O? Nope. There are none. So the current approach is to run blocking file I/O operations in a thread pool. Iconic workaround, honestly.
For a thorough explanation of the whole cross-platform file I/O landscape, check out this post <https://blog.libtorrent.org/2012/10/asynchronous-disk-io/>.
libuv currently uses a global thread pool on which all loops can queue work. And 3 types of operations are currently run on this pool:
- File system operations
- DNS functions (
getaddrinfoandgetnameinfo) - User specified code via
uv_queue_work()
Warning bestie: see the Thread pool work scheduling section for more details, but keep in mind the thread pool size is quite limited. ๐ซถ
๐ฆ API documentation
๐ Error handling
In libuv, errors are negative numbered constants. Rule of thumb: whenever there's a status parameter, or an API function returns an integer, a negative number implies an error. That's the whole tell, iykyk.
When a function which takes a callback returns an error, the callback will never be called. Not once. Not ever. ๐ญ
Note: implementation detail โ on Unix, error codes are the negatederrno(or-errno), while on Windows they're defined by libuv to arbitrary negative numbers.
โจ Error constants
UV_E2BIGโ argument list too longUV_EACCESโ permission deniedUV_EADDRINUSEโ address already in useUV_EADDRNOTAVAILโ address not availableUV_EAFNOSUPPORTโ address family not supportedUV_EAGAINโ resource temporarily unavailableUV_EAI_ADDRFAMILYโ address family not supportedUV_EAI_AGAINโ temporary failureUV_EAI_BADFLAGSโ badai_flagsvalueUV_EAI_BADHINTSโ invalid value for hintsUV_EAI_CANCELEDโ request canceledUV_EAI_FAILโ permanent failureUV_EAI_FAMILYโai_familynot supportedUV_EAI_MEMORYโ out of memoryUV_EAI_NODATAโ no addressUV_EAI_NONAMEโ unknown node or serviceUV_EAI_OVERFLOWโ argument buffer overflowUV_EAI_PROTOCOLโ resolved protocol is unknownUV_EAI_SERVICEโ service not available for socket typeUV_EAI_SOCKTYPEโ socket type not supportedUV_EALREADYโ connection already in progressUV_EBADFโ bad file descriptorUV_EBUSYโ resource busy or lockedUV_ECANCELEDโ operation canceledUV_ECHARSETโ invalid Unicode characterUV_ECONNABORTEDโ software caused connection abortUV_ECONNREFUSEDโ connection refusedUV_ECONNRESETโ connection reset by peerUV_EDESTADDRREQโ destination address requiredUV_EEXISTโ file already existsUV_EFAULTโ bad address in system call argumentUV_EFBIGโ file too largeUV_EHOSTUNREACHโ host is unreachableUV_EINTRโ interrupted system callUV_EINVALโ invalid argumentUV_EIOโ i/o errorUV_EISCONNโ socket is already connectedUV_EISDIRโ illegal operation on a directoryUV_ELOOPโ too many symbolic links encounteredUV_EMFILEโ too many open filesUV_EMSGSIZEโ message too longUV_ENAMETOOLONGโ name too longUV_ENETDOWNโ network is downUV_ENETUNREACHโ network is unreachableUV_ENFILEโ file table overflowUV_ENOBUFSโ no buffer space availableUV_ENODEVโ no such deviceUV_ENOENTโ no such file or directoryUV_ENOMEMโ not enough memoryUV_ENONETโ machine is not on the networkUV_ENOPROTOOPTโ protocol not availableUV_ENOSPCโ no space left on deviceUV_ENOSYSโ function not implementedUV_ENOTCONNโ socket is not connectedUV_ENOTDIRโ not a directoryUV_ENOTEMPTYโ directory not emptyUV_ENOTSOCKโ socket operation on non-socketUV_ENOTSUPโ operation not supported on socketUV_EOVERFLOWโ value too large for defined data typeUV_EPERMโ operation not permittedUV_EPIPEโ broken pipeUV_EPROTOโ protocol errorUV_EPROTONOSUPPORTโ protocol not supportedUV_EPROTOTYPEโ protocol wrong type for socketUV_ERANGEโ result too largeUV_EROFSโ read-only file systemUV_ESHUTDOWNโ cannot send after transport endpoint shutdownUV_ESPIPEโ invalid seekUV_ESRCHโ no such processUV_ETIMEDOUTโ connection timed outUV_ETXTBSYโ text file is busyUV_EXDEVโ cross-device link not permittedUV_UNKNOWNโ unknown errorUV_EOFโ end of fileUV_ENXIOโ no such device or addressUV_EMLINKโ too many linksUV_ENOTTYโ inappropriate ioctl for deviceUV_EFTYPEโ inappropriate file type or formatUV_EILSEQโ illegal byte sequenceUV_ESOCKTNOSUPPORTโ socket type not supportedUV_EUNATCHโ protocol driver not attached
๐ API
UV_ERRNO_MAP(iter_macro)โ Macro that expands to a series of invocations ofiter_macrofor each of the error constants above.iter_macrois invoked with two arguments: the name of the error constant without theUV_prefix, and the error message string literal.const char *uv_strerror(int err)โ Returns the error message for the given error code. Leaks a few bytes of memory when you call it with an unknown error code. ๐ (yes, really, that's canon)char *uv_strerror_r(int err, char *buf, size_t buflen)โ Returns the error message for the given error code. The zero-terminated message is stored in the user-supplied bufferbufof at mostbuflenbytes.
Added in version 1.22.0.
const char *uv_err_name(int err)โ Returns the error name for the given error code. Leaks a few bytes of memory when you call it with an unknown error code.char *uv_err_name_r(int err, char *buf, size_t buflen)โ Returns the error name for the given error code. The zero-terminated name is stored in the user-supplied bufferbufof at mostbuflenbytes.
Added in version 1.22.0.
int uv_translate_sys_error(int sys_errno)โ Returns the libuv error code equivalent to the given platform dependent error code: POSIX error codes on Unix (the ones stored inerrno), and Win32 error codes on Windows (those returned byGetLastError()orWSAGetLastError()).
If sys_errno is already a libuv error, it is simply returned. No notes. ๐
Changed in version 1.10.0: function declared public.
๐ Version-checking macros and functions
Starting with version 1.0.0, libuv follows the semantic versioning <https://semver.org> scheme. Which means new APIs can absolutely pop up throughout the lifetime of a major release โ so this section has all the macros and functions that let you write or compile code conditionally, so you can work with multiple libuv versions at once. Bestie behaviour, fr fr.
๐ Macros
UV_VERSION_MAJORโ libuv version's major number.UV_VERSION_MINORโ libuv version's minor number.UV_VERSION_PATCHโ libuv version's patch number.UV_VERSION_IS_RELEASEโ Set to1to indicate a release version of libuv,0for a development snapshot.UV_VERSION_SUFFIXโ libuv version suffix. Certain development releases such as Release Candidates might have a suffix such as"rc".UV_VERSION_HEXโ Returns the libuv version packed into a single integer. 8 bits are used for each component, with the patch number stored in the 8 least significant bits. E.g. for libuv 1.2.3 this would be0x010203.
Added in version 1.7.0.
โญ Functions
unsigned int uv_version(void)โ ReturnsUV_VERSION_HEX.const char *uv_version_string(void)โ Returns the libuv version number as a string. For non-release versions the version suffix is included.
๐ฆ uv_loop_t โ Event loop
The event loop is the central part of libuv's functionality โ the main character, honestly. It takes care of polling for i/o and scheduling callbacks to be run based on different sources of events.
๐ Data types
type uv_loop_tโ Loop data type.enum uv_loop_optionโ Additional loop options. Seeuv_loop_configure().
typedef enum {
UV_LOOP_BLOCK_SIGNAL = 0,
UV_METRICS_IDLE_TIME,
UV_LOOP_USE_IO_URING_SQPOLL
} uv_loop_option;
enum uv_run_modeโ Mode used to run the loop withuv_run().
typedef enum {
UV_RUN_DEFAULT = 0,
UV_RUN_ONCE,
UV_RUN_NOWAIT
} uv_run_mode;
typedef void (*uv_walk_cb)(uv_handle_t *handle, void *arg)โ Type definition for callback passed touv_walk().
๐ Public members
void *uv_loop_t.dataโ Space for user-defined arbitrary data. libuv does not use and does not touch this field. It's yours, bestie, go off. ๐ซถ
โจ API
int uv_loop_init(uv_loop_t *loop)โ Initializes the givenuv_loop_tstructure.int uv_loop_configure(uv_loop_t *loop, uv_loop_option option, ...)โ Added in version 1.0.2.
Set additional loop options. You should normally call this before the first call to uv_run() unless mentioned otherwise.
Returns 0 on success or a UV_E* error code on failure. Be prepared to handle UV_ENOSYS โ that means the loop option is not supported by the platform. No cap, you gotta check for it.
Supported options:
UV_LOOP_BLOCK_SIGNAL: Block a signal when polling for new events. The second argument touv_loop_configure()is the signal number.
This operation is currently only implemented for SIGPROF signals, to suppress unnecessary wakeups when using a sampling profiler. Requesting other signals will fail with UV_EINVAL. ๐
UV_METRICS_IDLE_TIME: Accumulate the amount of idle time the event loop spends in the event provider.
This option is necessary to use uv_metrics_idle_time().
UV_LOOP_USE_IO_URING_SQPOLLโ turns on the SQPOLL io_uring instance so asynchronous file system operations get handled ๐
Changed in version 1.39.0: added the UV_METRICS_IDLE_TIME option.
Changed in version 1.49.0: added the UV_LOOP_USE_IO_URING_SQPOLL option.
๐ int uv_loop_close(uv_loop_t *loop)
Okay so this one frees literally all the internal loop resources โจ But โ and this is the important part bestie โ only call it when the loop has finished executing and all open handles and requests have been closed. Otherwise it just returns UV_EBUSY and gives you nothing ๐ญ
Once it comes back successfully, you're free to free the memory you allocated for the loop. Cleanup queen behavior, we love to see it ๐
๐ฆ uv_loop_t *uv_default_loop(void)
Gives you back the initialized default loop ๐ It can return NULL if allocation fails, so likeโฆ check it, bestie.
This is literally just the convenient way to have one global loop across your whole app. The default loop is in no way different from ones you make with uv_loop_init(). So obviously it can โ and should โ be closed with uv_loop_close() so its resources get freed. No special treatment, no main character exception โจ
โ ๏ธ Warning: this function is not thread safe. Do not be passing it around between threads, ngl.
๐ฅ int uv_run(uv_loop_t *loop, uv_run_mode mode)
This runs the event loop, and it behaves differently depending on which mode you hand it ๐
UV_RUN_DEFAULTโ runs the event loop until there are no more active and referenced handles or requests left. Returns non-zero ifuv_stop()was called and there are still active handles or requests. Returns zero in all other cases.UV_RUN_ONCEโ polls for i/o once. Heads up: this one blocks if there are no pending callbacks ๐ Returns zero when it's done (no active handles or requests left), or non-zero if more callbacks are expected โ meaning you should run the event loop again sometime in the future.UV_RUN_NOWAITโ polls for i/o once but does not block when there are no pending callbacks. Returns zero if it's done (no active handles or requests left), or non-zero if more callbacks are expected โ same deal, run the loop again sometime later.
๐ Big one: uv_run() is not reentrant. It must not be called from a callback. Periodt.
โญ int uv_loop_alive(const uv_loop_t *loop)
Returns non-zero if there are referenced active handles, active requests, or closing handles chilling in the loop โจ Basically a vibe check for "is anything still happening in here".
๐ void uv_stop(uv_loop_t *loop)
Stops the event loop, making uv_run() end as soon as possible. But not sooner than the next loop iteration, bestie โ it's not instant magic ๐
Oh and if you called this before it started blocking for i/o, the loop won't block for i/o on this iteration. Slay.
๐ธ size_t uv_loop_size(void)
Returns the size of the uv_loop_t structure ๐ซถ Made for the FFI binding writers who don't wanna know the structure layout. Respect the hustle.
๐ int uv_backend_fd(const uv_loop_t *loop)
Gets the backend file descriptor. Only kqueue, epoll and event ports are supported, so likeโฆ know your platform ๐
You can pair this with uv_run(loop, UV_RUN_NOWAIT) to poll in one thread and run the event loop's callbacks in another โ go look at test/test-embed.c for an example, it's giving tutorial energy โจ
๐ Note: embedding akqueuefd in anotherkqueuepollset doesn't work on all platforms. It's not an error to add the fd, it just never generates events ๐
๐ int uv_backend_timeout(const uv_loop_t *loop)
Gets the poll timeout โฐ Return value is in milliseconds, or -1 when there's no timeout at all.
๐ง uint64_t uv_now(const uv_loop_t *loop)
Returns the current timestamp in milliseconds โจ It's cached at the start of the event loop tick โ check uv_update_time() for the details and the reasoning behind that.
The timestamp increases monotonically from some arbitrary point in time. So please don't go making assumptions about the starting point, you will only get disappointed ๐ญ๐
๐ Note: use uv_hrtime() if you need sub-millisecond granularity. She's the precision one.
๐ void uv_update_time(uv_loop_t *loop)
Updates the event loop's whole concept of "now" ๐ซถ Libuv caches the current time at the start of the event loop tick purely to cut down on time-related system calls. Efficient icon behavior.
You won't normally need to call this unless you've got callbacks that block the event loop for longer periods of time โ and "longer" is kinda subjective, but probably on the order of a millisecond or more. Iykyk โณ
๐ void uv_walk(uv_loop_t *loop, uv_walk_cb walk_cb, void *arg)
Walks the list of handles: walk_cb gets executed with the given arg. That's it, that's the whole thing ๐
๐ฆ int uv_loop_fork(uv_loop_t *loop)
Added in version 1.12.0.
Reinitializes any kernel state that's necessary in the child process after a fork(2) system call ๐ฑ
Watchers that were already started will keep on being started in the child process. No rest for the watchers.
Okay so this part is required: you have to explicitly call this function on every event loop created in the parent process that you plan to keep using in the child โ including the default loop, even if you don't continue using it in the parent. And it must be called before calling uv_run() or any other API function that uses the loop in the child.
๐ If you skip it: undefined behaviour, bestie. Possibly duplicate events delivered to both parent and child, or the child process just aborting. Not cute.
When it's possible, it's preferred to create a brand new loop in the child process instead of reusing one created in the parent. New loops created in the child after the fork should not use this function โ they're fresh, they're fine ๐
This function is not implemented on Windows, where it returns UV_ENOSYS.
โ ๏ธ Caution: this function is experimental. It may contain bugs, and it's subject to change or removal. API and ABI stability is not guaranteed ๐ญ
๐ Note: on Mac OS X, if directory FS event handles were in use in the parent process for any event loop, the child process will no longer be able to use the most efficient FSEvent implementation. Instead, uses of directory FS event handles in the child fall back to the same implementation used for files and on other kqueue-based systems ๐
โ ๏ธ Caution: on AIX and SunOS, FS event handles that were already started in the parent process at the time of forking will not deliver events in the child process โ they must be closed and restarted. On all other platforms they'll keep working normally without any further intervention โจ
โ ๏ธ Caution: any previous value you got from uv_backend_fd() is now invalid. Call it again to determine the correct backend file descriptor, no cap ๐
๐ void *uv_loop_get_data(const uv_loop_t *loop)
Returns loop->data.
Added in version 1.19.0.
๐ void uv_loop_set_data(uv_loop_t *loop, void *data)
Sets loop->data to data.
Added in version 1.19.0.
๐ uv_handle_t โ Base handle ๐
uv_handle_t is the base type for all libuv handle types ๐ซถ
Structures are aligned so that any libuv handle can be cast to uv_handle_t, and all the API functions defined here work with any handle type. Universal icon behavior โจ
๐ฆ Important: libuv handles are not movable. Pointers to handle structures passed to functions must remain valid for the duration of the requested operation. So take care when you're using stack allocated handles โ do not let them go out of scope on you ๐ญ
๐ธ Data types ๐ธ
type uv_handle_tโ the base libuv handle type.enum uv_handle_typeโ the kind of the libuv handle ๐
typedef enum {
UV_UNKNOWN_HANDLE = 0,
UV_ASYNC,
UV_CHECK,
UV_FS_EVENT,
UV_FS_POLL,
UV_HANDLE,
UV_IDLE,
UV_NAMED_PIPE,
UV_POLL,
UV_PREPARE,
UV_PROCESS,
UV_STREAM,
UV_TCP,
UV_TIMER,
UV_TTY,
UV_UDP,
UV_SIGNAL,
UV_FILE,
UV_HANDLE_TYPE_MAX
} uv_handle_type;
type uv_any_handleโ union of all handle types.typedef void (*uv_alloc_cb)(uv_handle_t *handle, size_t suggested_size, uv_buf_t *buf)โ type definition for the callback you pass touv_read_start()anduv_udp_recv_start(). You, the user, must allocate memory and fill the supplieduv_buf_tstructure ๐ IfNULLis assigned as the buffer's base or0as its length, aUV_ENOBUFSerror gets triggered in theuv_udp_recv_cbor theuv_read_cbcallback ๐ญ
Each buffer is used only once, and you're responsible for freeing it in the uv_udp_recv_cb or the uv_read_cb callback. No leaks, bestie ๐ซถ
A suggested size is provided (65536 at the moment in most cases), but it's literally just an indication โ not related in any way to the pending data to be read. You're free to allocate however much memory you decide.
For example, apps with custom allocation schemes โ freelists, allocation pools, slab based allocators โ might decide to use a different size that matches the memory chunks they already have. Smart, honestly โจ
Example:
static void my_alloc_cb(uv_handle_t* handle, size_t suggested_size, uv_buf_t* buf) {
buf->base = malloc(suggested_size);
buf->len = suggested_size;
}
typedef void (*uv_close_cb)(uv_handle_t *handle)โ type definition for the callback passed touv_close().
๐ฆ Public members ๐ฆ
uv_loop_t *uv_handle_t.loopโ pointer to theuv_loop_tthe handle is running on. Readonly ๐uv_handle_type uv_handle_t.typeโ theuv_handle_type, indicating the type of the underlying handle. Readonly ๐void *uv_handle_t.dataโ space for user-defined arbitrary data. libuv does not use this field. It's all yours, go wild ๐
API โจ
UV_HANDLE_TYPE_MAP(iter_macro)โ a macro that expands into a whole lil series of invocations ofiter_macro, one per handle type ๐ซถ. Each time it's called,iter_macrogets two arguments: the name of theuv_handle_typeelement without theUV_prefix, and the name of the matching structure type without theuv_prefix and_tsuffix. iykyk ๐ธint uv_is_active(const uv_handle_t *handle)โ returns non-zero if the handle is active, zero if it's inactive. And what "active" even means? bestie it depends on the handle type ๐ :- A
uv_async_thandle is always active and cannot be deactivated, except by closing it withuv_close(). - A
uv_pipe_t,uv_tcp_t,uv_udp_t, etc. handle โ basically any handle that deals with i/o โ is active when it's doing something that involves i/o, like reading, writing, connecting, accepting new connections, etc. ๐ฆ - A
uv_check_t,uv_idle_t,uv_timer_t, etc. handle is active when it has been started with a call touv_check_start(),uv_idle_start(), etc.
- A
Rule of thumb, and this one's iconic: if a handle of type uv_foo_t has a uv_foo_start() function, then it's active from the moment that function is called. Likewise, uv_foo_stop() deactivates the handle again ๐
int uv_is_closing(const uv_handle_t *handle)โ returns non-zero if the handle is closing or closed, zero otherwise.
Note ๐: this function should only be used between the initialization of the handle and the arrival of the close callback.
void uv_close(uv_handle_t *handle, uv_close_cb close_cb)โ requests the handle to be closed.close_cbgets called asynchronously after this call. This MUST be called on each handle before memory is released ๐ญ. Moreover โ and this is the part people fumble โ the memory can only be released inclose_cbor after it has returned.
Handles that wrap file descriptors are closed immediately, but close_cb will still be deferred to the next iteration of the event loop. That's literally giving you a chance to free up any resources associated with the handle ๐ซถ.
In-progress requests, like uv_connect_t or uv_write_t, are cancelled and have their callbacks called asynchronously with status=UV_ECANCELED.
close_cb can be NULL in cases where no cleanup or deallocation is necessary ๐.
void uv_ref(uv_handle_t *handle)โ references the given handle. References are idempotent, that is, if a handle is already referenced, calling this function again will have no effect. See Reference counting โจvoid uv_unref(uv_handle_t *handle)โ unreferences the given handle. References are idempotent, that is, if a handle is not referenced, calling this function again will have no effect. See Reference counting โจint uv_has_ref(const uv_handle_t *handle)โ returns non-zero if the handle is referenced, zero otherwise. See Reference counting โจsize_t uv_handle_size(uv_handle_type type)โ returns the size of the given handle type. Useful for FFI binding writers who don't want to know the structure layout ๐ง
Miscellaneous API functions ๐
The following API functions take a uv_handle_t argument, but they work just for some handle types. slay, but selectively ๐
int uv_send_buffer_size(uv_handle_t *handle, int *value)โ gets or sets the size of the send buffer that the operating system uses for the socket.
If *value == 0, then it will set *value to the current send buffer size. If *value > 0 then it will use *value to set the new send buffer size.
On success, zero is returned. On error, a negative result is returned.
This function works for TCP, pipe and UDP handles on Unix, and for TCP and UDP handles on Windows.
Note ๐: Linux will set double the size and return double the size of the original set value. yes, double. no, that's not a typo, that's just Linux being Linux ๐
int uv_recv_buffer_size(uv_handle_t *handle, int *value)โ gets or sets the size of the receive buffer that the operating system uses for the socket.
If *value == 0, then it will set *value to the current receive buffer size. If *value > 0 then it will use *value to set the new receive buffer size.
On success, zero is returned. On error, a negative result is returned.
This function works for TCP, pipe and UDP handles on Unix, and for TCP and UDP handles on Windows.
Note ๐: Linux will set double the size and return double the size of the original set value. same deal, bestie ๐
int uv_fileno(const uv_handle_t *handle, uv_os_fd_t *fd)โ gets the platform dependent file descriptor equivalent.
The following handles are supported: TCP, pipes, TTY, UDP and poll. Passing any other handle type will fail with UV_EINVAL.
If a handle doesn't have an attached file descriptor yet, or the handle itself has been closed, this function will return UV_EBADF.
Warning ๐: be very careful when using this function. libuv assumes it's in control of the file descriptor, so any change to it may lead to malfunction. like, do not touch, the vibes are load-bearing ๐ญ
uv_loop_t *uv_handle_get_loop(const uv_handle_t *handle)โ returnshandle->loop.
Added in version 1.19.0.
void *uv_handle_get_data(const uv_handle_t *handle)โ returnshandle->data.
Added in version 1.19.0.
void uv_handle_set_data(uv_handle_t *handle, void *data)โ setshandle->datatodata.
Added in version 1.19.0.
uv_handle_type uv_handle_get_type(const uv_handle_t *handle)โ returnshandle->type.
Added in version 1.19.0.
const char *uv_handle_type_name(uv_handle_type type)โ returns the name for the equivalent struct for a given handle type, e.g."pipe"(as inuv_pipe_t) forUV_NAMED_PIPE. ๐ฆ
If no such handle type exists, this returns NULL.
Added in version 1.19.0.
Reference counting ๐ฅ
The libuv event loop (if run in the default mode) will run until there are no active and referenced handles left. The user can force the loop to exit early by unreferencing handles which are active โ for example, by calling uv_unref() after calling uv_timer_start(). main character energy: you decide when the loop leaves the party ๐
A handle can be referenced or unreferenced, and the refcounting scheme doesn't use a counter, so both operations are idempotent. no cap, there's no number going up and down ๐
All handles are referenced when active by default. See uv_is_active() for a more detailed explanation on what being active involves.
uv_req_t โ Base request ๐
uv_req_t is the base type for all libuv request types.
Structures are aligned so that any libuv request can be cast to uv_req_t. All API functions defined here work with any request type. it's giving "universal base class" and honestly? iconic ๐
Data types โจ
type uv_req_tโ the base libuv request structure.type uv_any_reqโ union of all request types.enum uv_req_typeโ the kind of the libuv request. ๐
typedef enum {
UV_UNKNOWN_REQ = 0,
UV_REQ,
UV_CONNECT,
UV_WRITE,
UV_SHUTDOWN,
UV_UDP_SEND,
UV_FS,
UV_WORK,
UV_GETADDRINFO,
UV_GETNAMEINFO,
UV_REQ_TYPE_MAX,
} uv_req_type;
Public members ๐ซถ
void *uv_req_t.dataโ space for user-defined arbitrary data. libuv does not use this field. it's yours, bestie, decorate it however you want ๐ธuv_req_type uv_req_t.typeโ theuv_req_type, indicating the type of the request. Readonly. hands off ๐
API ๐
UV_REQ_TYPE_MAP(iter_macro)โ macro that expands to a series of invocations ofiter_macrofor each of the request types.iter_macrois invoked with two arguments: the name of theuv_req_typeelement without theUV_prefix, and the name of the corresponding structure type without theuv_prefix and_tsuffix. โจint uv_cancel(uv_req_t *req)โ cancel a pending request. Fails if the request is executing or has finished executing. Write requests are an exception though ๐: cancellation of a write that is already in progress will attempt to interrupt it (the callback may report a partial write), and cancellation of an already-completed write is a successful no-op.
Returns 0 on success, or an error code < 0 on failure.
Only cancellation of uv_write_t, uv_fs_t, uv_getaddrinfo_t, uv_getnameinfo_t, uv_random_t and uv_work_t requests is currently supported.
Cancelled requests have their callbacks invoked some time in the future. It's not safe to free the memory associated with the request until the callback is called. like, do not free yet, the callback hasn't shown up ๐ญ
Here's how cancellation is reported to the callback:
- A
uv_fs_trequest has itsreq->resultfield set toUV_ECANCELED. - A
uv_work_t,uv_getaddrinfo_t,uv_getnameinfo_toruv_random_trequest has its callback invoked withstatus == UV_ECANCELED. - A
uv_write_trequest has its callback invoked withstatus == UV_ECANCELED. Useuv_write_nwritten()from the callback to determine how many bytes were written before cancellation. Fully cancelled writes (where no bytes were written) may have their callbacks called out of order with respect to other writes on the same stream. Note that cancelled writes may still succeed or fail with other errors if the kernel finished processing the write before the cancellation took effect. the kernel said "too late bestie" ๐
size_t uv_req_size(uv_req_type type)โ returns the size of the given request type. Useful for FFI binding writers who don't want to know the structure layout ๐งvoid *uv_req_get_data(const uv_req_t *req)โ returnsreq->data.
Added in version 1.19.0.
void uv_req_set_data(uv_req_t *req, void *data)โ setsreq->datatodata.
Added in version 1.19.0. โจ
๐ uv_req_get_type
uv_req_type uv_req_get_type(const uv_req_t *req)
Bestie this one is so simple it's basically a vibe check โ it just hands you back req->type. That's it. That's the whole function. ๐
Added in version 1.19.0.
๐ uv_req_type_name
const char *uv_req_type_name(uv_req_type type)
Gives you the name for the equivalent struct for a given request type. Like, for UV_CONNECT you get "connect" (as in uv_connect_t โ see what they did there? ๐ฆ).
And if no such request type exists? It returns NULL. No cap, no drama, just NULL. ๐
Added in version 1.19.0.
๐ uv_timer_t โ the Timer handle
Okay so timer handles are literally the "call me later" of libuv โ they schedule callbacks to be called in the future. โฐโจ
Timers come in two flavors: single-shot or repeating. Repeating timers do not adjust for overhead but are rearmed relative to the event loop's idea of "now".
Libuv updates its idea of "now" right before executing timer callbacks, and right after waking up from waiting for I/O. See also uv_update_time().
Example that eats: a repeating timer with a 50 ms interval whose callback takes 17 ms to complete, runs again 33 ms later. If other tasks take longer than 33 ms, the timer callback runs as soon as possible. ๐
๐ง Data types
type uv_timer_tโ Timer handle type.typedef void (*uv_timer_cb)(uv_timer_t *handle)โ Type definition for callback passed touv_timer_start().
๐ง Public members
N/A ๐ซฅ
See also: the uv_handle_t members also apply.
๐ง API
int uv_timer_init(uv_loop_t *loop, uv_timer_t *handle)โ Initialize the handle. Baby's first step. ๐ฑint uv_timer_start(uv_timer_t *handle, uv_timer_cb cb, uint64_t timeout, uint64_t repeat)โ Start the timer.timeoutandrepeatare in milliseconds.
If timeout is zero, the callback fires on the next event loop iteration. If repeat is non-zero, the callback fires first after timeout milliseconds and then repeatedly after repeat milliseconds.
Note: Does not update the event loop's concept of"now". Seeuv_update_time()for more information. Also โ if the timer is already active, it is simply updated. No restart drama, it just updates. ๐
int uv_timer_stop(uv_timer_t *handle)โ Stop the timer, the callback will not be called anymore. Ghosted. ๐ปint uv_timer_again(uv_timer_t *handle)โ Stop the timer, and if it is repeating restart it using therepeatvalue as thetimeout. If the timer has never been started before it returnsUV_EINVAL. ๐ญvoid uv_timer_set_repeat(uv_timer_t *handle, uint64_t repeat)โ Set the repeat interval value in milliseconds. The timer will be scheduled to run on the given interval, regardless of the callback execution duration, and will follow normal timer semantics in the case of a time-slice overrun.
Note: If therepeatvalue is set from a timer callback it does not immediately take effect. If the timer was non-repeating before, it will have been stopped. If it was repeating, then the oldrepeatvalue will have been used to schedule the next timeout. Timing is everything, bestie. โณ
uint64_t uv_timer_get_repeat(const uv_timer_t *handle)โ Get the timer repeat value.uint64_t uv_timer_get_due_in(const uv_timer_t *handle)โ Get the timer due value or0if it has expired. The time is relative touv_now(). ๐ธ
Added in version 1.40.0.
See also: the uv_handle_t API functions also apply.
๐
uv_prepare_t โ the Prepare handle
Prepare handles will run the given callback once per loop iteration, right before polling for i/o. Think of it as the "get ready, we're about to go look for work" moment. ๐ง
๐ง Data types
type uv_prepare_tโ Prepare handle type.typedef void (*uv_prepare_cb)(uv_prepare_t *handle)โ Type definition for callback passed touv_prepare_start().
๐ง Public members
N/A ๐ซฅ
See also: the uv_handle_t members also apply.
๐ง API
int uv_prepare_init(uv_loop_t *loop, uv_prepare_t *prepare)โ Initialize the handle. This function always succeeds.
Returns: 0 โ
int uv_prepare_start(uv_prepare_t *prepare, uv_prepare_cb cb)โ Start the handle with the given callback. This function always succeeds, except whencbisNULL.
Returns: 0 on success, or UV_EINVAL when cb == NULL.
int uv_prepare_stop(uv_prepare_t *prepare)โ Stop the handle, the callback will no longer be called. This function always succeeds.
Returns: 0 โ
See also: the uv_handle_t API functions also apply.
โ
uv_check_t โ the Check handle
Check handles will run the given callback once per loop iteration, right after polling for i/o. Prepare's sibling, basically โ same energy, opposite side of the poll. ๐
๐ง Data types
type uv_check_tโ Check handle type.typedef void (*uv_check_cb)(uv_check_t *handle)โ Type definition for callback passed touv_check_start().
๐ง Public members
N/A ๐ซฅ
See also: the uv_handle_t members also apply.
๐ง API
int uv_check_init(uv_loop_t *loop, uv_check_t *check)โ Initialize the handle. This function always succeeds.
Returns: 0 โ
int uv_check_start(uv_check_t *check, uv_check_cb cb)โ Start the handle with the given callback. This function always succeeds, except whencbisNULL.
Returns: 0 on success, or UV_EINVAL when cb == NULL.
int uv_check_stop(uv_check_t *check)โ Stop the handle, the callback will no longer be called. This function always succeeds.
Returns: 0 โ
See also: the uv_handle_t API functions also apply.
๐ค uv_idle_t โ the Idle handle
Idle handles will run the given callback once per loop iteration, right before the uv_prepare_t handles. Early bird energy. ๐ฆ
Note: The notable difference with prepare handles is that when there are active idle handles, the loop will perform a zero timeout poll instead of blocking for i/o.
Warning: Despite the name, idle handles will get their callbacks called on every loop iteration, not when the loop is actually "idle". The name is lying to you, bestie. It's giving misleading branding. ๐
๐ง Data types
type uv_idle_tโ Idle handle type.typedef void (*uv_idle_cb)(uv_idle_t *handle)โ Type definition for callback passed touv_idle_start().
๐ง Public members
N/A ๐ซฅ
See also: the uv_handle_t members also apply.
๐ง API
int uv_idle_init(uv_loop_t *loop, uv_idle_t *idle)โ Initialize the handle. This function always succeeds.
Returns: 0 โ
int uv_idle_start(uv_idle_t *idle, uv_idle_cb cb)โ Start the handle with the given callback. This function always succeeds, except whencbisNULL.
Returns: 0 on success, or UV_EINVAL when cb == NULL.
int uv_idle_stop(uv_idle_t *idle)โ Stop the handle, the callback will no longer be called. This function always succeeds.
Returns: 0 โ
See also: the uv_handle_t API functions also apply.
๐ฃ uv_async_t โ the Async handle
Async handles allow the user to "wakeup" the event loop and get a callback called from another thread. Cross-thread communication, but make it cute. ๐ฆ
Note:uv_async_send()and theuv_async_cbinvocation are sequentially consistent (seq_cst) operations for a given async handle: all memory accesses (reads and writes) made beforeuv_async_send()are visible to that callback.
Warning: libuv will coalesce calls touv_async_send()โ that is, not every call to it will yield an execution of the callback. For example: ifuv_async_send()is called 5 times in a row before the callback is called, the callback will only be called once. Ifuv_async_send()is called again after the callback was called, it will be called again. However, since it is sequentially consistent, the values read or written in that callback will always be the same (or newer) as those read or written by the other thread. ๐ฅ
Changed in version 1.53.0: uv_async_send() and uv_async_cb are sequentially consistent. Prior to this version, any case where libuv might coalesce calls probably requires a full seq_cst fence before it for correctness.
๐ง Data types
type uv_async_tโ Async handle type.typedef void (*uv_async_cb)(uv_async_t *handle)โ Type definition for callback passed touv_async_init().
๐ง Public members
N/A ๐ซฅ
See also: the uv_handle_t members also apply.
๐ง API
int uv_async_init(uv_loop_t *loop, uv_async_t *async, uv_async_cb async_cb)โ Initialize the handle. ANULLcallback is allowed.
Returns: 0 on success, or an error code < 0 on failure.
Note: Unlike other handle initialization functions, it immediately starts the handle. No waiting around, it's already on main character energy the second it exists. โญ
int uv_async_send(uv_async_t *async)โ Wake up the event loop and call the async handle's callback.
Returns: 0 on success, or an error code < 0 on failure.
Note: It's safe to call this function from any thread. The callback will be called on the loop thread.
Note: uv_async_send() is async-signal-safe. It's safe to call this function from a signal handler. ๐ซถ
Note: This is a full memory fence with respect to other calls and callbacks using this same async handle, and so it will order all operations around this call and the corresponding callback on the sending thread and receiving thread. Memory-ordering queen. ๐
See also: the uv_handle_t API functions also apply.
๐ uv_poll_t โ the Poll handle
Poll handles are used to watch file descriptors for readability, writability and disconnection โ similar to the purpose of poll(2). Basically libuv's little spy on your file descriptors. ๐ต๏ธโโ๏ธ
The whole point of poll handles, bestie, is so you can plug in external libraries that rely on the event loop to tell them when a socket's status changes โ think c-ares or libssh2. That's the gig. Using uv_poll_t for literally anything else? Not recommended, ngl. uv_tcp_t, uv_udp_t, etc. give you an implementation that's faster and more scalable than anything you can pull off with uv_poll_t, especially on Windows. ๐
Okay and here's a lil reality check: poll handles might occasionally signal that a file descriptor is readable or writable even when it so isn't. So the user should always be prepared to handle EAGAIN or equivalent when it tries to read from or write to the fd. Don't get caught lacking. ๐ญ
It is not okay to have multiple active poll handles for the same socket โ that can cause libuv to busyloop or otherwise malfunction. One handle, one socket, periodt.
Also, the user should not close a file descriptor while it is being polled by an active poll handle. Like, this can cause the handle to report an error, but it might also start polling another socket (chaos, no cap). The fd can however be safely closed immediately after a call to uv_poll_stop() or uv_close().
Note: On Windows only sockets can be polled with poll handles. On Unix, any file descriptor that would be accepted by poll(2) can be used.
Note: On AIX, watching for disconnection is not supported. ๐
Data types
type uv_poll_tโ Poll handle type. That's the whole vibe.typedef void (*uv_poll_cb)(uv_poll_t *handle, int status, int events)โ Type definition for the callback passed touv_poll_start().enum uv_poll_eventโ Poll event types:
enum uv_poll_event {
UV_READABLE = 1,
UV_WRITABLE = 2,
UV_DISCONNECT = 4,
UV_PRIORITIZED = 8
};
Public members
N/A. Nothing here, bestie โ but see also: the uv_handle_t members also apply. ๐ซถ
API
int uv_poll_init(uv_loop_t *loop, uv_poll_t *handle, int fd)โ Initialize the handle using a file descriptor.
Changed in version 1.2.2: the file descriptor is set to non-blocking mode.
int uv_poll_init_socket(uv_loop_t *loop, uv_poll_t *handle, uv_os_sock_t socket)โ Initialize the handle using a socket descriptor. On Unix this is identical touv_poll_init(). On Windows it takes aSOCKEThandle.
Changed in version 1.2.2: the socket is set to non-blocking mode.
int uv_poll_start(uv_poll_t *handle, int events, uv_poll_cb cb)โ Starts polling the file descriptor.eventsis a bitmask made up ofUV_READABLE,UV_WRITABLE,UV_PRIORITIZEDandUV_DISCONNECT. As soon as an event is detected the callback will be called withstatusset to0, and the detected events set on theeventsfield.
The UV_PRIORITIZED event is used to watch for sysfs interrupts or TCP out-of-band messages. ๐
The UV_DISCONNECT event is optional in the sense that it may not be reported and the user is free to ignore it, but it can help optimize the shutdown path because an extra read or write call might be avoided.
If an error happens while polling, status will be < 0 and corresponds with one of the UV_E* error codes (see Error handling). The user should not close the socket while the handle is active. If the user does that anyway, the callback may be called reporting an error status, but this is not guaranteed. If status == UV_EBADF polling is discontinued for the file handle and no further events will be reported. The user should then call uv_close() on the handle. ๐
Note: Calling uv_poll_start() on a handle that is already active is fine. Doing so will update the events mask that is being watched for.
Note: ThoughUV_DISCONNECTcan be set, it is unsupported on AIX and as such will not be set on theeventsfield in the callback.
Note: If one of the eventsUV_READABLEorUV_WRITABLEare set, the callback will be called again, as long as the given fd/socket remains readable or writable accordingly. Particularly in each of the following scenarios: - The callback has been called because the socket became readable/writable and the callback did not conduct a read/write on this socket at all. - The callback committed a read on the socket, and has not read all the available data (whenUV_READABLEis set). - The callback committed a write on the socket, but it remained writable afterwards (whenUV_WRITABLEis set). - The socket has already became readable/writable before callinguv_poll_start()on a poll handle associated with this socket, and since then the state of the socket did not changed. In all of the above listed scenarios, the socket remains readable or writable and hence the callback will be called again (depending on the events set in the bitmask). This behaviour is known as level triggering. โญ
Changed in version 1.9.0: Added theUV_DISCONNECTevent. Changed in version 1.14.0: Added theUV_PRIORITIZEDevent.
int uv_poll_stop(uv_poll_t *poll)โ Stop polling the file descriptor, the callback will no longer be called.
Note: Calling uv_poll_stop() is effective immediately: any pending callback is also canceled, even if the socket state change notification was already pending. ๐ง
See also: the uv_handle_t API functions also apply.
๐ธ uv_signal_t --- Signal handle ๐ธ
Signal handles implement Unix style signal handling on a per-event loop bases. Slay.
Windows notes
Reception of some signals is emulated:
SIGINTis normally delivered when the user pressesCTRL+C. However, like on Unix, it is not generated when terminal raw mode is enabled.SIGBREAKis delivered when the user pressedCTRL + BREAK.SIGHUPis generated when the user closes the console window. OnSIGHUPthe program is given approximately 10 seconds to perform cleanup. After that Windows will unconditionally terminate it. ๐ญSIGWINCHis raised whenever libuv detects that the console has been resized. When a libuv app is running under a console emulator, or when a 32-bit libuv app is running on 64-bit system,SIGWINCHwill be emulated. In such casesSIGWINCHsignals may not always be delivered in a timely manner. For a writableuv_tty_thandle libuv will only detect size changes when the cursor is moved. When a readableuv_tty_thandle is used, resizing of the console buffer will be detected only if the handle is in raw mode and is being read.- Watchers for other signals can be successfully created, but these signals are never received. These signals are:
SIGILL,SIGABRT,SIGFPE,SIGSEGV,SIGTERMandSIGKILL. ๐ - Calls to
raise()orabort()to programmatically raise a signal are not detected by libuv; these will not trigger a signal watcher.
Changed in version 1.15.0:SIGWINCHsupport on Windows was improved. Changed in version 1.31.0: 32-bit libuvSIGWINCHsupport on 64-bit Windows was rolled back to old implementation.
Unix notes
SIGKILLandSIGSTOPare impossible to catch.- Handling
SIGBUS,SIGFPE,SIGILLorSIGSEGVvia libuv results into undefined behavior. ๐จ SIGABRTwill not be caught by libuv if generated byabort(), e.g. throughassert().- On Linux
SIGRT0andSIGRT1(signals 32 and 33) are used by the NPTL pthreads library to manage threads. Installing watchers for those signals will lead to unpredictable behavior and is strongly discouraged. Future versions of libuv may simply reject them. ๐ฅ
Data types
type uv_signal_tโ Signal handle type.typedef void (*uv_signal_cb)(uv_signal_t *handle, int signum)โ Type definition for the callback passed touv_signal_start().
Public members
int uv_signal_t.signumโ Signal being monitored by this handle. Readonly.
See also: the uv_handle_t members also apply. ๐ซถ
API
int uv_signal_init(uv_loop_t *loop, uv_signal_t *signal)โ Initialize the handle.int uv_signal_start(uv_signal_t *signal, uv_signal_cb cb, int signum)โ Start the handle with the given callback, watching for the given signal.int uv_signal_start_oneshot(uv_signal_t *signal, uv_signal_cb cb, int signum)โ Same functionality asuv_signal_start()but the signal handler is reset the moment the signal is received.
Added in version 1.12.0.
int uv_signal_stop(uv_signal_t *signal)โ Stop the handle, the callback will no longer be called.
See also: the uv_handle_t API functions also apply.
๐ฆ uv_process_t --- Process handle ๐ฆ
Process handles will spawn a new process and allow the user to control it and establish communication channels with it using streams. Main character energy fr fr.
Data types
type uv_process_tโ Process handle type.type uv_process_options_tโ Options for spawning the process (passed touv_spawn()).
typedef struct uv_process_options_s {
uv_exit_cb exit_cb;
const char* file;
char** args;
char** env;
const char* cwd;
unsigned int flags;
int stdio_count;
uv_stdio_container_t* stdio;
uv_uid_t uid;
uv_gid_t gid;
} uv_process_options_t;
typedef void (*uv_exit_cb)(uv_process_t*, int64_t exit_status, int term_signal)โ Type definition for the callback passed inuv_process_options_twhich will indicate the exit status and the signal that caused the process to terminate, if any.enum uv_process_flagsโ Flags to be set on theflagsfield ofuv_process_options_t. โจ
๐ enum uv_process_flags โ the little switchboard for uv_spawn()
okay so before we talk about spawning anything, here's the whole flag menu, copied exactly, no cap:
enum uv_process_flags {
/*
* Set the child process' user id.
*/
UV_PROCESS_SETUID = (1 << 0),
/*
* Set the child process' group id.
*/
UV_PROCESS_SETGID = (1 << 1),
/*
* Do not wrap any arguments in quotes, or perform any other escaping, when
* converting the argument list into a command line string. This option is
* only meaningful on Windows systems. On Unix it is silently ignored.
*/
UV_PROCESS_WINDOWS_VERBATIM_ARGUMENTS = (1 << 2),
/*
* Spawn the child process in a detached state - this will make it a process
* group leader, and will effectively enable the child to keep running after
* the parent exits. Note that the child process will still keep the
* parent's event loop alive unless the parent process calls uv_unref() on
* the child's process handle.
*/
UV_PROCESS_DETACHED = (1 << 3),
/*
* Hide the subprocess window that would normally be created. This option is
* only meaningful on Windows systems. On Unix it is silently ignored.
*/
UV_PROCESS_WINDOWS_HIDE = (1 << 4),
/*
* Hide the subprocess console window that would normally be created. This
* option is only meaningful on Windows systems. On Unix it is silently
* ignored.
*/
UV_PROCESS_WINDOWS_HIDE_CONSOLE = (1 << 5),
/*
* Hide the subprocess GUI window that would normally be created. This
* option is only meaningful on Windows systems. On Unix it is silently
* ignored.
*/
UV_PROCESS_WINDOWS_HIDE_GUI = (1 << 6),
/*
* On Windows, if the path to the program to execute, specified in
* uv_process_options_t's file field, has a directory component,
* search for the exact file name before trying variants with
* extensions like '.exe' or '.cmd'.
*/
UV_PROCESS_WINDOWS_FILE_PATH_EXACT_NAME = (1 << 7)
};
and here's what each one is giving, one by one ๐ซถ
UV_PROCESS_SETUIDโ sets the child process' user id.UV_PROCESS_SETGIDโ sets the child process' group id.UV_PROCESS_WINDOWS_VERBATIM_ARGUMENTSโ do not wrap any arguments in quotes, and don't do any other escaping, when the argument list gets converted into a command line string. this one is only meaningful on Windows; on Unix it's silently ignored.UV_PROCESS_DETACHEDโ spawns the child in a detached state, which makes it a process group leader, and effectively lets the child keep running after the parent exits. โ ๏ธ but heads up: the child process will still keep the parent's event loop alive unless the parent process callsuv_unref()on the child's process handle.UV_PROCESS_WINDOWS_HIDEโ hides the subprocess window that would normally be created. Windows-only; on Unix, silently ignored.UV_PROCESS_WINDOWS_HIDE_CONSOLEโ hides the subprocess console window that would normally be created. Windows-only; on Unix, silently ignored.UV_PROCESS_WINDOWS_HIDE_GUIโ hides the subprocess GUI window that would normally be created. Windows-only; on Unix, silently ignored.UV_PROCESS_WINDOWS_FILE_PATH_EXACT_NAMEโ on Windows, if the path to the program to execute (that's thefilefield ofuv_process_options_t) has a directory component, it searches for the exact file name before trying variants with extensions like'.exe'or'.cmd'. ๐ฏ
๐ฆ uv_stdio_container_t
literally just: the container for each stdio handle or fd that gets passed to a child process.
typedef struct uv_stdio_container_s {
uv_stdio_flags flags;
union {
uv_stream_t* stream;
int fd;
} data;
} uv_stdio_container_t;
๐ enum uv_stdio_flags
these ones specify how a stdio should be transmitted to the child process. iconique behaviour:
typedef enum {
/*
* The following four options are mutually-exclusive, and define
* the operation to perform for the corresponding file descriptor
* in the child process:
*/
/*
* No file descriptor will be provided (or redirected to
* `/dev/null` if it is fd 0, 1 or 2).
*/
UV_IGNORE = 0x00,
/*
* Open a new pipe into `data.stream`, per the flags below. The
* `data.stream` field must point to a uv_pipe_t object that has
* been initialized with `uv_pipe_init(loop, data.stream, ipc);`,
* but not yet opened or connected.
/*
UV_CREATE_PIPE = 0x01,
/*
* The child process will be given a duplicate of the parent's
* file descriptor given by `data.fd`.
*/
UV_INHERIT_FD = 0x02,
/*
* The child process will be given a duplicate of the parent's
* file descriptor being used by the stream handle given by
* `data.stream`.
*/
UV_INHERIT_STREAM = 0x04,
/*
* When UV_CREATE_PIPE is specified, UV_READABLE_PIPE and UV_WRITABLE_PIPE
* determine the direction of flow, from the child process' perspective. Both
* flags may be specified to create a duplex data stream.
*/
UV_READABLE_PIPE = 0x10,
UV_WRITABLE_PIPE = 0x20,
/*
* When UV_CREATE_PIPE is specified, specifying UV_NONBLOCK_PIPE opens the
* handle in non-blocking mode in the child. This may cause loss of data,
* if the child is not designed to handle to encounter this mode,
* but can also be significantly more efficient.
*/
UV_NONBLOCK_PIPE = 0x40
} uv_stdio_flags;
ngl bestie, that comment block aboveUV_CREATE_PIPEcloses with/*instead of*/โ that's literally how it's written on the page and i'm not touching it ๐ who am i to edit the sacred text
and the rundown, flag by flag ๐
- the first four are mutually exclusive, and they define the operation to perform for the corresponding file descriptor in the child process:
UV_IGNORE=0x00โ no file descriptor will be provided (or it gets redirected to/dev/nullif it's fd 0, 1 or 2).UV_CREATE_PIPE=0x01โ opens a new pipe intodata.stream, per the flags below. thedata.streamfield must point to auv_pipe_tobject that's been initialized withuv_pipe_init(loop, data.stream, ipc);but not yet opened or connected โจUV_INHERIT_FD=0x02โ the child process gets a duplicate of the parent's file descriptor given bydata.fd.UV_INHERIT_STREAM=0x04โ the child process gets a duplicate of the parent's file descriptor being used by the stream handle given bydata.stream.UV_READABLE_PIPE=0x10,UV_WRITABLE_PIPE=0x20โ whenUV_CREATE_PIPEis specified, these determine the direction of flow, from the child process' perspective. both flags can be specified together to create a duplex data stream ๐UV_NONBLOCK_PIPE=0x40โ whenUV_CREATE_PIPEis specified, this opens the handle in non-blocking mode in the child. โ ๏ธ this may cause loss of data if the child isn't designed to handle encountering this mode โ but it can also be significantly more efficient. risk vs reward, your call ๐
๐ Public members
int uv_process_t.pidโ the PID of the spawned process. it's set after callinguv_spawn()and it retains that value even after the process exits. important vibe check: the value is only unique while the process is alive โ after exit, another process may be reassigned the same PID.- Note: the
uv_handle_tmembers also apply. uv_exit_cb uv_process_options_t.exit_cbโ callback called after the process exits. ๐ซถconst char *uv_process_options_t.fileโ path pointing to the program to be executed.char **uv_process_options_t.argsโ command line arguments.args[0]should be the path to the program. on Windows this uses CreateProcess, which concatenates the arguments into a string โ that can cause some strange errors ๐ญ. see theUV_PROCESS_WINDOWS_VERBATIM_ARGUMENTSflag onuv_process_flags.char **uv_process_options_t.envโ environment for the new process. ifNULL, the parent's environment is used.const char *uv_process_options_t.cwdโ current working directory for the subprocess.unsigned int uv_process_options_t.flagsโ various flags that control howuv_spawn()behaves. seeuv_process_flags.int uv_process_options_t.stdio_countuv_stdio_container_t *uv_process_options_t.stdioโ the stdio field points to an array ofuv_stdio_container_tstructs that describe the file descriptors that will be made available to the child process. the convention is thatstdio[0]points to stdin, fd 1 is used for stdout, and fd 2 is stderr.- Note: on Windows, file descriptors greater than 2 are available to the child process only if the child process uses the MSVCRT runtime.
uv_uid_t uv_process_options_t.uiduv_gid_t uv_process_options_t.gidโ libuv can change the child process' user/group id. this happens only when the appropriate bits are set in the flags fields.- Note: this is not supported on Windows โ
uv_spawn()will fail and set the error toUV_ENOTSUP. ๐ uv_stdio_flags uv_stdio_container_t.flagsโ flags specifying how the stdio container should be passed to the child.union [anonymous] uv_stdio_container_t.dataโ union containing either the stream or fd to be passed on to the child process.
โจ API โจ
๐ง void uv_disable_stdio_inheritance(void)
disables inheritance for file descriptors / handles that this process inherited from its parent. the effect? child processes spawned by this process don't accidentally inherit these handles. not me preventing generational trauma ๐
it's recommended to call this function as early in your program as possible, before the inherited file descriptors can be closed or duplicated. โฐ
Note: this function works on a best-effort basis โ there's no guarantee that libuv can discover all file descriptors that were inherited. in general it does a better job on Windows than it does on Unix.
๐ธ int uv_spawn(...)
int uv_spawn(uv_loop_t *loop, uv_process_t *handle, const uv_process_options_t *options)
initializes the process handle and starts the process. if the process is successfully spawned, this function returns 0. otherwise, the negative error code corresponding to the reason it couldn't spawn is returned. and here's the part everyone forgets: either way โ success or failure โ you must eventually call uv_close() to close the handle again before freeing the memory of the handle. unlike the other init functions in libuv. ๐ like, yes, even the fail case, bestie.
possible reasons for failing to spawn would include (but not be limited to) the file to execute not existing, not having permissions to use the setuid or setgid specified, or not having enough memory to allocate for the new process.
Warning: on unix, if the process has not yet exited when you calluv_close, you will create a zombie that libuv cannot reap. you are responsible for callingwaitpidlater. this is not relevant on Windows. ๐งโโ๏ธ
Changed in version 1.24.0: added UV_PROCESS_WINDOWS_HIDE_CONSOLE and UV_PROCESS_WINDOWS_HIDE_GUI flags.
Changed in version 1.48.0: added the UV_PROCESS_WINDOWS_FILE_PATH_EXACT_NAME flag.
๐ฅ int uv_process_kill(uv_process_t *handle, int signum)
sends the specified signal to the given process handle. check the documentation on uv_signal_t โ Signal handle for signal support, specially on Windows.
if the specified process is already dead, this will not kill a different process which happened to reuse the same pid. by contrast, uv_kill may kill an arbitrary other process if you use a cached value of uv_process_get_pid(). ๐ญ that's the whole difference and it matters.
โญ int uv_kill(int pid, int signum)
sends the specified signal to the given PID. check the documentation on uv_signal_t โ Signal handle for signal support, specially on Windows.
๐ uv_pid_t uv_process_get_pid(const uv_process_t *handle)
returns handle->pid. that's it, that's the function, she's simple and she slays ๐ซถ
Added in version 1.19.0.
okay and we're still going โ this is genuinely the middle of the process vibes, so keep scrolling bestie, there's more where that came from ๐
โจ See also: the uv_handle_t API functions also apply to all of this, bestie. Same family, same rules. ๐ซถ
๐ uv_stream_t โ Stream handle
Okay so picture a duplex communication channel โ both directions, sending and receiving, no cap. That's what stream handles abstract. uv_stream_t is an abstract type, which is fancy-speak for "not the whole story yet" โ libuv actually ships three real implementations of it: uv_tcp_t, uv_pipe_t, and uv_tty_t. Three flavors, one vibe. ๐
๐งฌ Data types
type uv_stream_tโ the stream handle type itself. The blueprint. ๐type uv_connect_tโ the connect request type.type uv_shutdown_tโ the shutdown request type.type uv_write_tโ the write request type. And listen, careful attention must be paid when you reuse objects of this type. When a stream is in non-blocking mode, write requests sent withuv_writeget queued up, and reusing objects at that point is undefined behaviour โ like, genuinely do-not-pass-go territory ๐ญ. It is safe to reuse theuv_write_tobject only after the callback passed touv_writeis fired. That's the finish line. Not before. Periodt.typedef void (*uv_read_cb)(uv_stream_t *stream, ssize_t nread, const uv_buf_t *buf)โ called when data was read on a stream. Here's the deal onnread: it's> 0if there's data available, or< 0on error. When we've hit EOF,nreadgets set toUV_EOF. And whennread < 0, thebufparameter might not point to a valid buffer at all โ in that casebuf.lenandbuf.baseare both set to0. โญ
Note:nreadmight be0, and that does not indicate an error or EOF, okay? It's equivalent toEAGAINorEWOULDBLOCKunderread(2). Don't panic. ๐
The callee is responsible for stopping/closing the stream when an error happens, by calling uv_read_stop() or uv_close(). Trying to read from the stream again after that is undefined. And the callee is also responsible for freeing the buffer โ libuv does not reuse it. That buffer may be a null buffer (where buf->base == NULL and buf->len == 0) on error. ๐ญ
typedef void (*uv_write_cb)(uv_write_t *req, int status)โ called after data was written on a stream.statuswill be0in case of success,< 0otherwise. Slay. โจtypedef void (*uv_connect_cb)(uv_connect_t *req, int status)โ called after a connection started byuv_connect()is done.statusis0on success,< 0otherwise.typedef void (*uv_shutdown_cb)(uv_shutdown_t *req, int status)โ called after a shutdown request has been completed. Same status deal:0good,< 0not good.typedef void (*uv_connection_cb)(uv_stream_t *server, int status)โ called when a stream server has received an incoming connection. You (the user) can accept that connection by callinguv_accept().statusis0on success,< 0otherwise. ๐ฆ
๐ Public members
size_t uv_stream_t.write_queue_sizeโ contains the amount of queued bytes waiting to be sent. Readonly, so don't even think about writing to it. ๐uv_stream_t *uv_connect_t.handleโ pointer to the stream where this connection request is running.uv_stream_t *uv_shutdown_t.handleโ pointer to the stream where this shutdown request is running.uv_stream_t *uv_write_t.handleโ pointer to the stream where this write request is running.uv_stream_t *uv_write_t.send_handleโ pointer to the stream being sent using this write request.
โจ See also: the uv_handle_t members also apply. The whole handle squad shares its stuff, iykyk.
๐ API
int uv_shutdown(uv_shutdown_t *req, uv_stream_t *handle, uv_shutdown_cb cb)โ shuts down the outgoing (write) side of a duplex stream. It waits for pending write requests to complete first, because we're polite. Thehandleshould refer to an initialized stream, andreqshould be an uninitialized shutdown request struct.cbis called after shutdown is complete. ๐int uv_listen(uv_stream_t *stream, int backlog, uv_connection_cb cb)โ start listening for incoming connections.backlogindicates the number of connections the kernel might queue, same aslisten(2). When a new incoming connection is received, theuv_connection_cbcallback gets called. ๐ฅint uv_accept(uv_stream_t *server, uv_stream_t *client)โ this call is used in conjunction withuv_listen()to accept incoming connections. Call it after receiving auv_connection_cbto accept the connection. Before calling this function theclienthandle must be initialized. A< 0return value indicates an error.
When the uv_connection_cb callback is called, it is guaranteed that this function will complete successfully the first time. If you attempt to use it more than once, it may fail. So the suggestion is: only call this function once per uv_connection_cb call. One and done. ๐
Note:serverandclientmust be handles running on the same loop. No mixing loops, bestie, that's chaos. ๐
int uv_read_start(uv_stream_t *stream, uv_alloc_cb alloc_cb, uv_read_cb read_cb)โ read data from an incoming stream. Theuv_read_cbcallback will be made several times until there's no more data to read oruv_read_stop()is called. ๐ธ
Changed in version 1.38.0: uv_read_start() now consistently returns UV_EALREADY when called twice, and UV_EINVAL when the stream is closing. With older libuv versions, it returns UV_EALREADY on Windows but not UNIX, and UV_EINVAL on UNIX but not Windows. (Iconic cross-platform chaos, we fixed it. ๐ซถ)
int uv_read_stop(uv_stream_t*)โ stop reading data from the stream. Theuv_read_cbcallback will no longer be called.
This function is idempotent and may be safely called on a stopped stream. It will always succeed โ hence, checking its return value is unnecessary. A non-zero return indicates that finishing releasing resources may be pending on the next input event on that TTY on Windows, and does not indicate failure. Don't read into it. ๐
int uv_write(uv_write_t *req, uv_stream_t *handle, const uv_buf_t bufs[], unsigned int nbufs, uv_write_cb cb)โ write data to a stream. Buffers are written in order, which is the whole point. Behold, an example:
void cb(uv_write_t* req, int status) {
/* Logic which handles the write result */
}
uv_buf_t a[] = {
{ .base = "1", .len = 1 },
{ .base = "2", .len = 1 }
};
uv_buf_t b[] = {
{ .base = "3", .len = 1 },
{ .base = "4", .len = 1 }
};
uv_write_t req1;
uv_write_t req2;
/* writes "1234" */
uv_write(&req1, stream, a, 2, cb);
uv_write(&req2, stream, b, 2, cb);
Note: the memory pointed to by the buffers must remain valid until the callback gets called. This also holds for uv_write2(). Do not free it early, I'm begging. ๐ญ
int uv_write2(uv_write_t *req, uv_stream_t *handle, const uv_buf_t bufs[], unsigned int nbufs, uv_stream_t *send_handle, uv_write_cb cb)โ the extended write function for sending handles over a pipe. The pipe must be initialized withipc == 1. ๐ฆ
Note: send_handle must be a TCP, pipe and UDP handle on Unix, or a TCP handle on Windows, which is a server or a connection (listening or connected state). Bound sockets or pipes will be assumed to be servers. ๐
int uv_try_write(uv_stream_t *handle, const uv_buf_t bufs[], unsigned int nbufs)โ same asuv_write(), but won't queue a write request if it can't be completed immediately. It'll return either:> 0: the number of bytes written (can be less than the supplied buffer size โ yeah, really).< 0: a negative error code (UV_EAGAINis returned if no data can be sent immediately).
int uv_try_write2(uv_stream_t *handle, const uv_buf_t bufs[], unsigned int nbufs, uv_stream_t *send_handle)โ same asuv_try_write()and an extended write function for sending handles over a pipe likeuv_write2. Trying to send a handle is not supported on Windows, where it returnsUV_EAGAIN. ๐
Added in version 1.42.0.
size_t uv_write_nwritten(const uv_write_t *req)โ returns the number of bytes written by a write request. Only valid when called from within the write callback (uv_write_cb). ๐
This is primarily useful when a write has been cancelled via uv_cancel() and the callback receives UV_ECANCELED status, so you can determine how many bytes were actually written before cancellation. Note that cancelled writes may still succeed or fail with other errors if the kernel finished processing the write before the cancellation took effect. The kernel does what it wants, honestly. ๐
Added in version 1.53.0.
int uv_is_readable(const uv_stream_t *handle)โ returns1if the stream is readable,0otherwise. โญint uv_is_writable(const uv_stream_t *handle)โ returns1if the stream is writable,0otherwise. โญint uv_stream_set_blocking(uv_stream_t *handle, int blocking)โ enable or disable blocking mode for a stream.
When blocking mode is enabled, all writes complete synchronously. The interface remains unchanged otherwise โ e.g. completion or failure of the operation will still be reported through a callback, which is made asynchronously. ๐
Warning: relying too much on this API is not recommended. It is likely to change significantly in the future. Currently only works on Windows foruv_pipe_thandles. On UNIX platforms, alluv_stream_thandles are supported. Also, libuv currently makes no ordering guarantee when the blocking mode is changed after write requests have already been submitted. So it's recommended to set the blocking mode immediately after opening or creating the stream. Before you get messy with it. ๐
Changed in version 1.4.0: UNIX implementation added.
size_t uv_stream_get_write_queue_size(const uv_stream_t *stream)
Okay bestie this one is so simple it's basically a flexion ๐
โ it just hands you back stream->write_queue_size. That's it. That's the whole function.
Added in version 1.19.0.
See also: The uv_handle_t API functions also apply. ๐ซถ
๐ฆ uv_tcp_t --- TCP handle ๐ฆ
So uv_tcp_t handles are the whole vibe for representing, like, both TCP streams and servers. One type, two moods, no cap.
And yes, uv_tcp_t is a 'subclass' of uv_stream_t โ it inherits the whole stream situation, so everything stream-y applies here too. ๐ง
โจ Data types โจ
type uv_tcp_t
The TCP handle type. That's the one. ๐
enum uv_tcp_flags
These are the flags you'd use in uv_tcp_bind(). Copy them exactly, bestie:
enum uv_tcp_flags {
/* Used with uv_tcp_bind, when an IPv6 address is used. */
UV_TCP_IPV6ONLY = 1,
/* Enable SO_REUSEPORT socket option when binding the handle.
* This allows completely duplicate bindings by multiple processes
* or threads if they all set SO_REUSEPORT before binding the port.
* Incoming connections are distributed across the participating
* listener sockets.
*
* This flag is available only on Linux 3.9+, DragonFlyBSD 3.6+,
* FreeBSD 12.0+, Solaris 11.4, and AIX 7.2.5+ for now.
*/
UV_TCP_REUSEPORT = 2,
};
๐ธ Public members ๐ธ
N/A. Literally none. Nothing to see here, move along. ๐
See also: The uv_stream_t members also apply.
๐ API ๐
int uv_tcp_init(uv_loop_t *loop, uv_tcp_t *handle)
Initializes the handle. Heads up though โ no socket is created as of yet. It's giving "set up but not set up," iykyk.
int uv_tcp_init_ex(uv_loop_t *loop, uv_tcp_t *handle, unsigned int flags)
Same deal but with flags so you can be specific. Right now only the lower 8 bits of the flags parameter get used, and they're used as the socket domain. A socket will be created for that domain. But if the domain you specified is AF_UNSPEC, then no socket is created โ exactly like uv_tcp_init().
Added in version 1.7.0.
int uv_tcp_open(uv_tcp_t *handle, uv_os_sock_t sock)
Opens an existing file descriptor or SOCKET and treats it as a TCP handle. Very "bring your own socket" energy. ๐
Changed in version 1.2.1: the file descriptor is set to non-blocking mode.
Note: the file descriptor or SOCKET you pass in is not checked for its type โ but it's still required that it represents a valid stream socket. So like, the library trusts you. Don't make it regret that. ๐ญ
int uv_tcp_nodelay(uv_tcp_t *handle, int enable)
Turns on TCP_NODELAY, which disables Nagle's algorithm. Nagle is over, we don't stan. โจ
int uv_tcp_keepalive(uv_tcp_t *handle, int enable, unsigned int delay)
Enables / disables TCP keep-alive. delay is the initial delay, in seconds โ and it gets ignored when enable is zero.
Once delay has been reached, there's still a whole saga: 10 successive probes, each spaced 1 second from the previous one, will still happen. If the connection is still lost at the end of that whole procedure, then the handle gets destroyed with a UV_ETIMEDOUT error passed to the corresponding callback. Rip bozo. ๐
If delay is less than 1, then UV_EINVAL is returned.
Changed in version 1.49.0: If delay is less than 1 then UV_EINVAL is returned.
int uv_tcp_keepalive_ex(uv_tcp_t *handle, int on, unsigned int idle, unsigned int intvl, unsigned int cnt)
The deluxe version โ enable / disable TCP keep-alive with all the socket options: TCP_KEEPIDLE, TCP_KEEPINTVL and TCP_KEEPCNT. So idle is the value for TCP_KEEPIDLE, intvl is the value for TCP_KEEPINTVL, cnt is the value for TCP_KEEPCNT. All of them ignored when on is zero.
With TCP keep-alive enabled, idle is the time (in seconds) the connection needs to remain idle before TCP starts sending keep-alive probes. intvl is the time (in seconds) between individual keep-alive probes. Then TCP will drop the connection after sending cnt probes without getting any replies from the peer, and then the handle is destroyed with a UV_ETIMEDOUT error passed to the corresponding callback. It really said "no reply? blocked." ๐ซ
If one of idle, intvl, or cnt is less than 1, UV_EINVAL is returned.
Changed in version 1.52.0: added support of setting TCP_KEEPINTVL and TCP_KEEPCNT socket options.
Note: make sure the socket options are actually supported by the underlying operating system. Currently supported platforms: - AIX - DragonFlyBSD - FreeBSD - illumos - Linux - macOS - NetBSD - Solaris - Windows
int uv_tcp_simultaneous_accepts(uv_tcp_t *handle, int enable)
Enable / disable simultaneous asynchronous accept requests that the OS queues up when it's listening for new TCP connections.
This is a tuning knob for getting the TCP server performance you want. Having simultaneous accepts can significantly improve the rate of accepting connections (which is why it is enabled by default ๐) but it may lead to uneven load distribution in multi-process setups. So it's a tradeoff, fr fr.
int uv_tcp_bind(uv_tcp_t *handle, const struct sockaddr *addr, unsigned int flags)
Binds the handle to an address and port. Iconic.
When the port is already taken, you can expect to see a UV_EADDRINUSE error from uv_listen() or uv_tcp_connect() โ unless you specify UV_TCP_REUSEPORT in flags for all the binding sockets. And like, a successful call to this function does not guarantee that the call to uv_listen() or uv_tcp_connect() will succeed as well. No promises, bestie.
Parameters
handle-- TCP handle. It should have been initialized withuv_tcp_init().addr-- Address to bind to. It should point to an initializedstruct sockaddr_inorstruct sockaddr_in6.flags-- Flags that control the behavior of binding the socket.UV_TCP_IPV6ONLYcan be contained inflagsto disable dual-stack support and only use IPv6.UV_TCP_REUSEPORTcan be contained inflagsto enable the socket optionSO_REUSEPORTwith the capability of load balancing that distribute incoming connections across all listening sockets in multiple processes or threads.
Returns 0 on success, or an error code < 0 on failure.
Changed in version 1.49.0: added the UV_TCP_REUSEPORT flag.
Note: theUV_TCP_REUSEPORTflag is available only on Linux 3.9+, DragonFlyBSD 3.6+, FreeBSD 12.0+, Solaris 11.4, and AIX 7.2.5+ at the moment. On other platforms this function will return anUV_ENOTSUPerror. ๐
int uv_tcp_getsockname(const uv_tcp_t *handle, struct sockaddr *name, int *namelen)
Gets you the current address the handle is bound to. name must point to a valid and big enough chunk of memory โ struct sockaddr_storage is the recommended pick so you're covered for both IPv4 and IPv6 support. ๐
int uv_tcp_getpeername(const uv_tcp_t *handle, struct sockaddr *name, int *namelen)
Same vibe, but for the address of the peer connected to the handle. Again, name must point to a valid and big enough chunk of memory, and struct sockaddr_storage is recommended for IPv4 and IPv6 support.
int uv_tcp_connect(uv_connect_t *req, uv_tcp_t *handle, const struct sockaddr *addr, uv_connect_cb cb)
Establishes an IPv4 or IPv6 TCP connection. Give it an initialized TCP handle and an uninitialized uv_connect_t. The addr should point to an initialized struct sockaddr_in or struct sockaddr_in6.
On Windows, if the addr is initialized to point to an unspecified address (0.0.0.0 or ::) it will be changed to point to localhost. That's on purpose, to match the behavior of Linux systems. ๐
The callback fires when the connection has been established, or when a connection error happened. Either way you're getting a callback, babe.
Changed in version 1.19.0: added 0.0.0.0 and :: to localhost mapping
See also: The uv_stream_t API functions also apply. ๐ซถ
int uv_tcp_close_reset(uv_tcp_t *handle, uv_close_cb close_cb)
Resets a TCP connection by sending a RST packet. It pulls this off by setting the SO_LINGER socket option with a linger interval of zero and then calling uv_close(). Cold. ๐ง
Because of some platform inconsistencies, mixing uv_shutdown() and uv_tcp_close_reset() calls is not allowed. Like, genuinely not allowed. Don't do it.
Added in version 1.32.0.
int uv_socketpair(int type, int protocol, uv_os_sock_t socket_vector[2], int flags0, int flags1)
Creates a pair of connected sockets with the properties you specify. The resulting handles can be passed to uv_tcp_open, used with uv_spawn, or honestly used for any other purpose you want. Versatile icon. โจ
Valid values for flags0 and flags1 are:
UV_NONBLOCK_PIPE: Opens the specified socket handle forOVERLAPPEDorFIONBIO/O_NONBLOCKI/O usage. This is recommended for handles that will be used by libuv, and not usually recommended otherwise.
Equivalent to socketpair(2) with a domain of AF_UNIX.
Added in version 1.41.0.
๐ uv_pipe_t --- Pipe handle ๐
Pipe handles are like... the abstraction layer over streaming files on Unix (that includes local domain sockets, pipes, and FIFOs) and named pipes on Windows. Very "one handle, many situations" of them. ๐
And yup, uv_pipe_t is a 'subclass' of uv_stream_t. Same family energy. ๐ง
๐ธ Data types ๐ธ
type uv_pipe_t
The pipe handle type. Boom, that's the type.
โญ Public members โญ
int uv_pipe_t.ipc
Whether this pipe is suitable for handle passing between processes. Only a connected pipe that will be passing the handles should have this flag set โ not the listening pipe that uv_accept is called on. That distinction matters, bestie, don't mix it up. ๐
See also: The uv_stream_t members also apply. ๐ซถ
๐ API ๐
int uv_pipe_init(uv_loop_t *loop, uv_pipe_t *handle, int ipc)
Initializes a pipe handle. The ipc argument is a boolean that says whether this pipe will be used for handle passing between processes (which may change the bytes on the wire ๐). And again, for emphasis: only a connected pipe that will be passing the handles should have this flag set, not the listening pipe that uv_accept is called on. ๐ซถ
int uv_pipe_open(uv_pipe_t *handle, uv_file file)
Open an already-existing file descriptor or HANDLE and treat it as a pipe ๐
Changed in version 1.2.1: the file descriptor gets set to non-blocking mode, okay?
โ ๏ธ Heads up bestie: the file descriptor or HANDLE you pass in is not type-checked. Like, nobody's vibe-checking it for you โ it's just required that it actually represents a valid pipe. So maybe don't lie to it. ๐ญ
int uv_pipe_bind(uv_pipe_t *handle, const char *name)
Bind the pipe to a file path (on Unix) or a name (on Windows) โจ
Does NOT support Linux abstract namespace sockets โ unlike uv_pipe_bind2(), which does. So if that's your thing, go use the other one, iykyk.
Lowkey it's just an alias for uv_pipe_bind2(handle, name, strlen(name), 0).
๐ธ Note: on Unix, paths get truncated to sizeof(sockaddr_un.sun_path) bytes โ typically somewhere between 92 and 108 bytes. So keep your names cute but short, bestie.
int uv_pipe_bind2(uv_pipe_t *handle, const char *name, size_t namelen, unsigned int flags)
Same deal: bind the pipe to a file path (Unix) or a name (Windows) ๐
flags must be zero or UV_PIPE_NO_TRUNCATE. If you hand it unsupported flags it returns UV_EINVAL without performing the bind operation at all โ like it just refuses, no bind, nothing happened, we move on.
This one does support Linux abstract namespace sockets. ๐
And listen: namelen must include the leading nul byte but not the trailing nul byte. Yes, that's real. Read it twice. ๐ซถ
Added in version 1.46.0.
๐ธ Note: on Unix, paths get truncated tosizeof(sockaddr_un.sun_path)bytes (usually 92โ108) unless you specified theUV_PIPE_NO_TRUNCATEflag โ in which case you get anUV_EINVALerror instead. Pick your fighter.
void uv_pipe_connect(uv_connect_t *req, uv_pipe_t *handle, const char *name, uv_connect_cb cb)
Connect to the Unix domain socket or the Windows named pipe ๐
Does not support Linux abstract namespace sockets โ unlike uv_pipe_connect2().
It's an alias for uv_pipe_connect2(req, handle, name, strlen(name), 0, cb) โ same energy, shorter name.
๐ Note: on Unix, paths get truncated to sizeof(sockaddr_un.sun_path) bytes, typically between 92 and 108 bytes.
int uv_pipe_connect2(uv_connect_t *req, uv_pipe_t *handle, const char *name, size_t namelen, unsigned int flags, uv_connect_cb cb)
Connect to the Unix domain socket or the Windows named pipe, but make it fancy โจ
flags must be zero or UV_PIPE_NO_TRUNCATE. Unsupported flags โ UV_EINVAL, and it bails without performing the connect operation. No connection, no drama.
Supports Linux abstract namespace sockets ๐
And again: namelen must include the leading nul byte, but not the trailing nul byte.
Added in version 1.46.0.
๐ธ Note: on Unix, paths get truncated tosizeof(sockaddr_un.sun_path)bytes (typically 92โ108) unlessUV_PIPE_NO_TRUNCATEis specified, in which case you getUV_EINVAL. Yes, same note as before. It's important, okay??
int uv_pipe_getsockname(const uv_pipe_t *handle, char *buffer, size_t *size)
Get the name of the Unix domain socket or the named pipe ๐ฆ
You must provide a preallocated buffer, bestie โ it's not gonna make one for you. The size parameter holds the length of the buffer going in, and gets set to the number of bytes written to the buffer on output. If your buffer isn't big enough you'll get UV_ENOBUFS back, and len will contain the required size โ so now you know exactly how much room you needed. ๐
On FreeBSD, UNIX domain socket paths cannot exceed the size of sockaddr_un.sun_path, even though the platform defines a SOCK_MAXADDRLEN that's larger. Like, it defines it, but it doesn't mean it. ๐
Changed in version 1.3.0: the returned length no longer includes the terminating null byte, and the buffer is not null terminated. Adjust your expectations accordingly.
int uv_pipe_getpeername(const uv_pipe_t *handle, char *buffer, size_t *size)
Get the name of the Unix domain socket or the named pipe to which the handle is connected โ the other side of the situationship ๐ซถ
Same rules: preallocated buffer, required. size holds the buffer length on the way in, and gets set to the number of bytes written on the way out. Not big enough? UV_ENOBUFS, and len tells you the required size.
Added in version 1.3.0.
void uv_pipe_pending_instances(uv_pipe_t *handle, int count)
Set the number of pending pipe instance handles for when the pipe server is waiting for connections ๐
๐ Note: this setting applies to Windows only. Unix girlies, this one's not for you.
int uv_pipe_pending_count(uv_pipe_t *handle)
uv_handle_type uv_pipe_pending_type(uv_pipe_t *handle)
These two are how you receive handles over IPC pipes ๐
The ritual goes like this:
- First โ call
uv_pipe_pending_count(). - If it's
> 0, then initialize a handle of the given type, returned byuv_pipe_pending_type(). - And call
uv_accept(pipe, handle).
That's it. That's the whole ceremony. โจ
๐ฆ See also: the uv_stream_t API functions also apply.
int uv_pipe_chmod(uv_pipe_t *handle, int flags)
Alters pipe permissions so it can be accessed from processes run by different users. Basically makes the pipe writable or readable by all users. Very generous of you. ๐ธ
Mode can be UV_WRITABLE, UV_READABLE, or UV_WRITABLE | UV_READABLE.
โ ๏ธ This function is blocking. Like, actually blocking. Just so you know.
Added in version 1.16.0.
int uv_pipe(uv_file fds[2], int read_flags, int write_flags)
Create a pair of connected pipe handles ๐ Data may be written to fds[1] and read from fds[0]. The resulting handles can be passed to uv_pipe_open, used with uv_spawn, or honestly used for any other purpose you can dream up.
Valid values for the flags are:
UV_NONBLOCK_PIPEโ Opens the specified socket handle forOVERLAPPEDorFIONBIO/O_NONBLOCKI/O usage. This is recommended for handles that will be used by libuv, and not usually recommended otherwise. So, like, context-dependent, bestie.
Equivalent to pipe(2) with the O_CLOEXEC flag set. ๐
Added in version 1.41.0.
๐ uv_tty_t --- TTY handle ๐
TTY handles represent a stream for the console ๐ฅ๏ธโจ
uv_tty_t is a 'subclass' of uv_stream_t. Family tree stuff.
Data types
type uv_tty_t
TTY handle type. That's the whole description. It's a handle. For TTYs. Iconic brevity. ๐
enum uv_tty_mode_t
Added in version 1.2.0.
TTY mode type:
typedef enum {
/* Initial/normal terminal mode */
UV_TTY_MODE_NORMAL,
/*
* Raw input mode (On Windows, ENABLE_WINDOW_INPUT is also enabled).
* May become equivalent to UV_TTY_MODE_RAW_VT in future libuv versions.
*/
UV_TTY_MODE_RAW,
/* Binary-safe I/O mode for IPC (Unix-only) */
UV_TTY_MODE_IO,
/* Raw input mode. On Windows ENABLE_VIRTUAL_TERMINAL_INPUT is also set. */
UV_TTY_MODE_RAW_VT
} uv_tty_mode_t;
enum uv_tty_vtermstate_t
Console virtual terminal mode type:
typedef enum {
/*
* The console supports handling of virtual terminal sequences
* (Windows10 new console, ConEmu)
*/
UV_TTY_SUPPORTED,
/* The console cannot process virtual terminal sequences. (Legacy
* console)
*/
UV_TTY_UNSUPPORTED
} uv_tty_vtermstate_t
Public members
N/A โ nothing to see here, move along ๐ฆ
๐ธ See also: the uv_stream_t members also apply.
API
int uv_tty_init(uv_loop_t *loop, uv_tty_t *handle, uv_file fd, int unused)
Initialize a new TTY stream with the given file descriptor ๐ Usually the file descriptor will be:
0= stdin1= stdout2= stderr
On Unix this function will determine the path of the fd of the terminal using ttyname_r(3), open it, and use it if the passed file descriptor refers to a TTY. This lets libuv put the tty in non-blocking mode without affecting other processes that share the tty. Considerate queen behavior. ๐
โ ๏ธ This function is not thread safe on systems that don't supportioctl TIOCGPTNorTIOCPTYGNAMEโ for instance OpenBSD and Solaris. Know your platform, bestie.
๐ Note: if reopening the TTY fails, libuv falls back to blocking writes. Not ideal, but it's what we've got.
Changed in version 1.23.1: the readable parameter is now unused and ignored. The correct value will now be auto-detected from the kernel. She's autonomous now. ๐
Changed in version 1.9.0: the path of the TTY is determined by ttyname_r(3). In earlier versions libuv opened /dev/tty instead.
Changed in version 1.5.0: trying to initialize a TTY stream with a file descriptor that refers to a file returns UV_EINVAL on UNIX. Rude, but fair.
int uv_tty_set_mode(uv_tty_t *handle, uv_tty_mode_t mode)
Changed in version 1.2.0: the mode is specified as a uv_tty_mode_t value.
Set the TTY using the specified terminal mode ๐
int uv_tty_reset_mode(void)
To be called when the program exits. Resets TTY settings to default values for the next process to take over โ like cleaning up after yourself at a sleepover ๐ซถ
โจ This function is async signal-safe on Unix platforms, but it can fail with error codeUV_EBUSYif you call it while execution is insideuv_tty_set_mode(). So maybe don't do that. ๐ญ
int uv_tty_get_winsize(uv_tty_t *handle, int *width, int *height)
Gets the current Window size. On success it returns 0. Simple. Clean. We love a zero return. ๐
๐ธ See also: the uv_stream_t API functions also apply.
void uv_tty_set_vterm_state(uv_tty_vtermstate_t state)
Controls whether console virtual terminal sequences are processed by libuv or by the console. Useful in particular for enabling ConEmu support of ANSI X3.64 and Xterm 256 colors ๐จ Otherwise Windows10 consoles are usually detected automatically โ she figures it out herself.
๐ This function is only meaningful on Windows systems. On Unix it is silently ignored. Like, it hears you, it's just not engaging.
Added in version 1.33.0.
int uv_tty_get_vterm_state(uv_tty_vtermstate_t *state)
Get the current state of whether console virtual terminal sequences are handled by libuv or by the console ๐
โ ๏ธ This function is not implemented on Unix, where it returns UV_ENOTSUP. Sorry Unix girlies, this one's Windows-only.
Added in version 1.33.0.
๐ฅ uv_udp_t --- UDP handle ๐ฅ
UDP handles encapsulate UDP communication for both clients and servers. Both sides of the coin, we love a versatile icon โจ
๐ฆ Data types ๐ฆ
okay so here are the actual type girlies for UDP, no cap:
type uv_udp_tโ UDP handle type. that's the main character handle ๐type uv_udp_send_tโ UDP send request type. the lil request object for sends โจ
enum uv_udp_flags โ flags used in uv_udp_bind() and uv_udp_recv_cb. yes bestie, these are the vibe switches ๐
enum uv_udp_flags {
/* Disables dual stack mode. */
UV_UDP_IPV6ONLY = 1,
/*
* Indicates message was truncated because read buffer was too small. The
* remainder was discarded by the OS. Used in uv_udp_recv_cb.
*/
UV_UDP_PARTIAL = 2,
/*
* Indicates if SO_REUSEADDR will be set when binding the handle.
* This sets the SO_REUSEPORT socket flag on the BSDs (except for
* DragonFlyBSD), OS X, and other platforms where SO_REUSEPORTs don't
* have the capability of load balancing, as the opposite of what
* UV_UDP_REUSEPORT would do. On other Unix platforms, it sets the
* SO_REUSEADDR flag. What that means is that multiple threads or
* processes can bind to the same address without error (provided
* they all set the flag) but only the last one to bind will receive
* any traffic, in effect "stealing" the port from the previous listener.
*/
UV_UDP_REUSEADDR = 4,
/*
* Indicates that the message was received by recvmmsg, so the buffer provided
* must not be freed by the recv_cb callback.
*/
UV_UDP_MMSG_CHUNK = 8,
/*
* Indicates that the buffer provided has been fully utilized by recvmmsg and
* that it should now be freed by the recv_cb callback. When this flag is set
* in uv_udp_recv_cb, nread will always be 0 and addr will always be NULL.
*/
UV_UDP_MMSG_FREE = 16,
/*
* Indicates if IP_RECVERR/IPV6_RECVERR will be set when binding the handle.
* This sets IP_RECVERR for IPv4 and IPV6_RECVERR for IPv6 UDP sockets on
* Linux. This stops the Linux kernel from suppressing some ICMP error messages
* and enables full ICMP error reporting for faster failover.
* This flag is no-op on platforms other than Linux.
*/
UV_UDP_LINUX_RECVERR = 32,
/*
* Indicates if SO_REUSEPORT will be set when binding the handle.
* This sets the SO_REUSEPORT socket option on supported platforms.
* Unlike UV_UDP_REUSEADDR, this flag will make multiple threads or
* processes that are binding to the same address and port "share"
* the port, which means incoming datagrams are distributed across
* the receiving sockets among threads or processes.
*
* This flag is available only on Linux 3.9+, DragonFlyBSD 3.6+,
* FreeBSD 12.0+, Solaris 11.4, and AIX 7.2.5+ for now.
*/
UV_UDP_REUSEPORT = 64,
/*
* Indicates that recvmmsg should be used, if available. The uv_alloc_cb
* for this handle should create buffers that are multiples of 64 KiB.
*/
UV_UDP_RECVMMSG = 256
};
typedef void (*uv_udp_send_cb)(uv_udp_send_t *req, int status) โ callback type for uv_udp_send(), called after the data was sent. it's giving โsend complete, bestieโ ๐
typedef void (*uv_udp_recv_cb)(uv_udp_t *handle, ssize_t nread, const uv_buf_t *buf, const struct sockaddr *addr, unsigned flags) โ callback type passed to uv_udp_recv_start(), called when the endpoint receives data. this is the โomg package arrivedโ callback ๐
the args are:
- handle โ UDP handle.
- nread โ number of bytes that have been received.
0if there is no more data to read. note that0may also mean that an empty datagram was received (in this case addr is notNULL).< 0if a transmission error was detected; if usingrecvmmsg(2)no more chunks will be received and the buffer can be freed safely. - buf โ
uv_buf_twith the received data. - addr โ
struct sockaddr*containing the address of the sender. can beNULL. valid for the duration of the callback only. - flags โ one or more or'ed
UV_UDP_*constants.
the callee is responsible for freeing the buffer, libuv does not reuse it. the buffer may be a null buffer (where buf->base == NULL and buf->len == 0) on error.
when using recvmmsg(2), chunks will have the UV_UDP_MMSG_CHUNK flag set, those must not be freed. if no errors occur, there will be a final callback with nread set to 0, addr set to NULL and the buffer pointing at the initially allocated data with the UV_UDP_MMSG_CHUNK flag cleared and the UV_UDP_MMSG_FREE flag set. if a UDP socket error occurs, nread will be < 0. in either scenario, the callee can now safely free the provided buffer.
changed in version 1.40.0: added the UV_UDP_MMSG_FREE flag.
Note: the receive callback will be called withnread == 0andaddr == NULLwhen there is nothing to read, and withnread == 0andaddr != NULLwhen an empty UDP packet is received. lowkey important bestie ๐ซถ
enum uv_membership โ membership type for a multicast address. literally the join/leave situation ๐
typedef enum {
UV_LEAVE_GROUP = 0,
UV_JOIN_GROUP
} uv_membership;
๐ Public members ๐
size_t uv_udp_t.send_queue_sizeโ number of bytes queued for sending. this field strictly shows how much information is currently queued. it's giving โhow full is the send queue rnโ ๐ฆsize_t uv_udp_t.send_queue_countโ number of send requests currently in the queue awaiting to be processed. yes, the count count ๐uv_udp_t *uv_udp_send_t.handleโ UDP handle where this send request is taking place.
See also: the uv_handle_t members also apply. so don't forget those bestie โจ
๐ API ๐
int uv_udp_init(uv_loop_t *loop, uv_udp_t *handle)โ initialize a new UDP handle. the actual socket is created lazily. returns0on success. lazy socket creation is so real ๐int uv_udp_init_ex(uv_loop_t *loop, uv_udp_t *handle, unsigned int flags)โ initialize the handle with the specified flags. the lower 8 bits of the flags parameter are used as the socket domain. a socket will be created for the given domain. if the specified domain isAF_UNSPECno socket is created, just likeuv_udp_init().
the remaining bits can be used to set one of these flags:
UV_UDP_RECVMMSG: if set, and the platform supports it,recvmmsg(2)will be used. theuv_alloc_cbfor this handle should create buffers that are multiples of64 KiB.
added in version 1.7.0.
changed in version 1.37.0: added the UV_UDP_RECVMMSG flag.
int uv_udp_open_ex(uv_udp_t *handle, uv_os_sock_t sock, unsigned int flags)โ opens an existing file descriptor or WindowsSOCKETas a UDP handle.
params, bestie:
- handle โ UDP handle. should have been initialized with
uv_udp_init(). - sock โ an existing socket to associate with the handle.
- flags โ flags that control socket behavior,
UV_UDP_REUSEADDR, andUV_UDP_REUSEPORTare supported.
returns 0 on success, or an error code < 0 on failure.
added in version 1.52.0.
int uv_udp_open(uv_udp_t *handle, uv_os_sock_t sock)โ opens an existing file descriptor or WindowsSOCKETas a UDP handle.
Unix only: the only requirement of the sock argument is that it follows the datagram contract (works in unconnected mode, supports sendmsg()/recvmsg(), etc). in other words, other datagram-type sockets like raw sockets or netlink sockets can also be passed to this function.
changed in version 1.2.1: the file descriptor is set to non-blocking mode.
Note: the passed file descriptor or SOCKET is not checked for its type, but it's required that it represents a valid datagram socket.
internally sets theSO_REUSEADDRsocket option unconditionally. this means the reuse flag is always enabled, regardless of user intent. for more control useuv_udp_open_ex(). periodt ๐
int uv_udp_bind(uv_udp_t *handle, const struct sockaddr *addr, unsigned int flags)โ bind the UDP handle to an IP address and port.
params:
- handle โ UDP handle. should have been initialized with
uv_udp_init(). - addr โ
struct sockaddr_inorstruct sockaddr_in6with the address and port to bind to. - flags โ indicate how the socket will be bound,
UV_UDP_IPV6ONLY,UV_UDP_REUSEADDR,UV_UDP_REUSEPORT, andUV_UDP_RECVERRare supported.
returns 0 on success, or an error code < 0 on failure.
changed in version 1.49.0: added the UV_UDP_REUSEPORT flag.
Note:UV_UDP_REUSEPORTflag is available only on Linux 3.9+, DragonFlyBSD 3.6+, FreeBSD 12.0+, Solaris 11.4, and AIX 7.2.5+ at the moment. on other platforms this function will return anUV_ENOTSUPerror. for platforms whereSO_REUSEPORThas the capability of load balancing, specifying bothUV_UDP_REUSEADDRandUV_UDP_REUSEPORTin flags is allowed andSO_REUSEPORTwill always override the behavior ofSO_REUSEADDR. for platforms whereSO_REUSEPORTdoesn't have the capability of load balancing, specifying bothUV_UDP_REUSEADDRandUV_UDP_REUSEPORTin flags will fail, returning anUV_ENOTSUPerror. no cap, that's the whole tea โ
๐
uv_udp_connect()
int uv_udp_connect(uv_udp_t *handle, const struct sockaddr *addr)
okay so this one is literally the "set it and forget it" of UDP ๐ธ โ you associate the handle with a remote address and port, and after that every message this handle sends automatically goes to that destination. No more typing the address every time, bestie. Iconic.
Calling it with a NULL addr disconnects the handle. And here's the vibe check you gotta pass: trying to call uv_udp_connect() on an already-connected handle gives you an UV_EISCONN error ๐ญ and trying to disconnect a handle that isn't connected gives you UV_ENOTCONN. So it's very much a "know your status" situation.
Parameters
handleโ the UDP handle. Should have been initialized withuv_udp_init().addrโ astruct sockaddr_inorstruct sockaddr_in6holding the address and port to associate to.
Returns 0 on success, or an error code < 0 on failure.
Added in version 1.27.0. โจ
๐ uv_udp_getpeername()
int uv_udp_getpeername(const uv_udp_t *handle, struct sockaddr *name, int *namelen)
Gets the remote IP and port of the UDP handle โ but only on connected UDP handles, bestie. On unconnected ones it just hands you an UV_ENOTCONN and refuses to engage ๐ (respect, honestly).
Parameters
handleโ the UDP handle. Should have been initialized withuv_udp_init()and bound.nameโ pointer to the structure that gets filled with the address data. In order to support IPv4 and IPv6,struct sockaddr_storageshould be used.namelenโ on input it indicates the data of thenamefield. On output it indicates how much of it was filled.
Returns 0 on success, or an error code < 0 on failure.
Added in version 1.27.0. ๐ฆ
๐ธ uv_udp_getsockname()
int uv_udp_getsockname(const uv_udp_t *handle, struct sockaddr *name, int *namelen)
Same energy as above but make it local โ this gives you the local IP and port of the UDP handle. Very "who am I, really" of it ๐ซถ.
Parameters
handleโ the UDP handle. Should have been initialized withuv_udp_init()and bound.nameโ pointer to the structure to be filled with the address data. In order to support IPv4 and IPv6,struct sockaddr_storageshould be used.namelenโ on input it indicates the data of thenamefield. On output it indicates how much of it was filled.
Returns 0 on success, or an error code < 0 on failure.
๐ uv_udp_set_membership()
int uv_udp_set_membership(uv_udp_t *handle, const char *multicast_addr, const char *interface_addr, uv_membership membership)
Set membership for a multicast address. It's giving "club membership but for packets" ๐.
Parameters
handleโ the UDP handle. Should have been initialized withuv_udp_init().multicast_addrโ the multicast address to set membership for.interface_addrโ interface address.membershipโ should beUV_JOIN_GROUPorUV_LEAVE_GROUP.
Returns 0 on success, or an error code < 0 on failure.
๐ uv_udp_set_source_membership()
int uv_udp_set_source_membership(uv_udp_t *handle, const char *multicast_addr, const char *interface_addr, const char *source_addr, uv_membership membership)
Set membership for a source-specific multicast group. Same as the one above but with extra โจ specificity โจ โ now you're picky about the source too, and honestly? Same.
Parameters
handleโ the UDP handle. Should have been initialized withuv_udp_init().multicast_addrโ the multicast address to set membership for.interface_addrโ interface address.source_addrโ source address.membershipโ should beUV_JOIN_GROUPorUV_LEAVE_GROUP.
Returns 0 on success, or an error code < 0 on failure.
Added in version 1.32.0. โญ
๐ uv_udp_set_multicast_loop()
int uv_udp_set_multicast_loop(uv_udp_t *handle, int on)
Sets the IP multicast loop flag โ which makes multicast packets loop back to local sockets. It's the "hear your own echo" button ๐.
Parameters
handleโ the UDP handle. Should have been initialized withuv_udp_init_ex()as eitherAF_INETorAF_INET6, or have been bound to an address explicitly withuv_udp_bind(), or implicitly withuv_udp_send()oruv_udp_recv_start().onโ1for on,0for off.
Returns 0 on success, or an error code < 0 on failure.
๐ก uv_udp_set_multicast_ttl()
int uv_udp_set_multicast_ttl(uv_udp_t *handle, int ttl)
Sets the multicast ttl. Short and sweet, no notes ๐ .
Parameters
handleโ the UDP handle. Should have been initialized withuv_udp_init_ex()as eitherAF_INETorAF_INET6, or have been bound to an address explicitly withuv_udp_bind(), or implicitly withuv_udp_send()oruv_udp_recv_start().ttlโ1through255.
Returns 0 on success, or an error code < 0 on failure.
๐ง uv_udp_set_multicast_interface()
int uv_udp_set_multicast_interface(uv_udp_t *handle, const char *interface_addr)
Sets the multicast interface to send or receive data on โ like picking which door the packets leave through ๐ชโจ.
Parameters
handleโ the UDP handle. Should have been initialized withuv_udp_init_ex()as eitherAF_INETorAF_INET6, or have been bound to an address explicitly withuv_udp_bind(), or implicitly withuv_udp_send()oruv_udp_recv_start().interface_addrโ interface address.
Returns 0 on success, or an error code < 0 on failure.
๐ข uv_udp_set_broadcast()
int uv_udp_set_broadcast(uv_udp_t *handle, int on)
Set broadcast on or off. Scream to the whole subnet or don't, your call ๐ฃ๏ธ๐.
Parameters
handleโ the UDP handle. Should have been initialized withuv_udp_init_ex()as eitherAF_INETorAF_INET6, or have been bound to an address explicitly withuv_udp_bind(), or implicitly withuv_udp_send()oruv_udp_recv_start().onโ1for on,0for off.
Returns 0 on success, or an error code < 0 on failure.
โณ uv_udp_set_ttl()
int uv_udp_set_ttl(uv_udp_t *handle, int ttl)
Sets the time to live. Lowkey the packet's little lifespan countdown โฑ๏ธ.
Parameters
handleโ the UDP handle. Should have been initialized withuv_udp_init_ex()as eitherAF_INETorAF_INET6, or have been bound to an address explicitly withuv_udp_bind(), or implicitly withuv_udp_send()oruv_udp_recv_start().ttlโ1through255.
Returns 0 on success, or an error code < 0 on failure.
๐ uv_udp_send()
int uv_udp_send(uv_udp_send_t *req, uv_udp_t *handle, const uv_buf_t bufs[], unsigned int nbufs, const struct sockaddr *addr, uv_udp_send_cb send_cb)
Sends data over the UDP socket, bestie! ๐ And if the socket hasn't previously been bound with uv_udp_bind(), it'll get bound to 0.0.0.0 (the "all interfaces" IPv4 address) and a random port number. Surprise binding, but make it functional.
On Windows, if addr is initialized to point to an unspecified address (0.0.0.0 or ::) it will be changed to point to localhost. That's done to match the behavior of Linux systems โ consistency slay ๐
.
Now pay attention because these two are the ones people mess up:
For connected UDP handles,addrmust be set toNULL, otherwise it will returnUV_EISCONNerror. For connectionless UDP handles,addrcannot beNULL, otherwise it will returnUV_EDESTADDRREQerror.
Parameters
reqโ UDP request handle. Need not be initialized.handleโ the UDP handle. Should have been initialized withuv_udp_init().bufsโ list of buffers to send.nbufsโ number of buffers inbufs.addrโstruct sockaddr_inorstruct sockaddr_in6with the address and port of the remote peer.send_cbโ callback to invoke when the data has been sent out.
Returns 0 on success, or an error code < 0 on failure.
Changed in version 1.19.0: added 0.0.0.0 and :: to localhost mapping
Changed in version 1.27.0: added support for connected sockets ๐
โก uv_udp_try_send()
int uv_udp_try_send(uv_udp_t *handle, const uv_buf_t bufs[], unsigned int nbufs, const struct sockaddr *addr)
Same as uv_udp_send(), but it won't queue a send request if it can't be completed immediately. No waiting around, no "I'll get to it later" energy โ it's now or never ๐ฅ.
Same rules as before, and yes they still matter:
For connected UDP handles,addrmust be set toNULL, otherwise it will returnUV_EISCONNerror. For connectionless UDP handles,addrcannot beNULL, otherwise it will returnUV_EDESTADDRREQerror.
Returns
>= 0: number of bytes sent (it matches the given buffer size).< 0: negative error code (UV_EAGAINis returned when the message can't be sent immediately).
Changed in version 1.27.0: added support for connected sockets โจ
๐ uv_udp_try_send2()
int uv_udp_try_send2(uv_udp_t *handle, unsigned int count, uv_buf_t *bufs[/*count*/], unsigned int nbufs[/*count*/], struct sockaddr *addrs[/*count*/], unsigned int flags)
Like uv_udp_try_send(), but it can send multiple datagrams at once. Main character energy, honestly ๐. It's a lightweight abstraction around sendmmsg(2), with a sendmsg(2) fallback loop for platforms that do not support the former. The handle must be fully initialized โ call uv_udp_bind first! (Not optional, bestie, that's a whole pre-requisite.)
Returns
>= 0: number of datagrams sent. Zero only ifcountwas zero.< 0: negative error code. Only if sending the first datagram fails, otherwise returns a positive send count.UV_EAGAINwhen datagrams cannot be sent right now; fall back touv_udp_send().
Added in version 1.50.0. ๐
๐ uv_udp_recv_start()
int uv_udp_recv_start(uv_udp_t *handle, uv_alloc_cb alloc_cb, uv_udp_recv_cb recv_cb)
Prepare for receiving data โ the "inbox open for business" moment ๐ฅโจ. If the socket has not previously been bound with uv_udp_bind() it is bound to 0.0.0.0 (the "all interfaces" IPv4 address) and a random port number.
Parameters
handleโ the UDP handle. Should have been initialized withuv_udp_init().alloc_cbโ callback to invoke when temporary storage is needed.recv_cbโ callback to invoke with received data.
Returns โ 0 on success, or an error code < 0 on failure. โจ
Note, bestie: when you're out here usingrecvmmsg(2)(https://man7.org/linux/man-pages/man2/recvmmsg.2.html), the number of messages you receive at a time is limited by how many max-size dgrams fit into the buffer you allocated inalloc_cb. And listen โsuggested_sizeinalloc_cbforudp_recvis always set to the size of exactly 1 max-size dgram. Always always. ๐
Changed in version 1.35.0: added support for recvmmsg(2) (https://man7.org/linux/man-pages/man2/recvmmsg.2.html) on supported platforms. The uv_alloc_cb for this handle should create buffers that are multiples of 64 KiB. ๐
Changed in version 1.37.0: recvmmsg(2) (https://man7.org/linux/man-pages/man2/recvmmsg.2.html) support is no longer enabled implicitly โ you have to explicitly request it by passing the UV_UDP_RECVMMSG flag to uv_udp_init_ex(). No more surprise freebies. ๐
Changed in version 1.39.0: uv_udp_using_recvmmsg() can be used in alloc_cb to determine if a buffer sized for use with recvmmsg(2) (https://man7.org/linux/man-pages/man2/recvmmsg.2.html) should be allocated for the current handle/platform. iykyk ๐ง
int uv_udp_using_recvmmsg(uv_udp_t *handle)
Returns 1 if the UDP handle was created with the UV_UDP_RECVMMSG flag and the platform supports recvmmsg(2) (https://man7.org/linux/man-pages/man2/recvmmsg.2.html), and 0 otherwise. That's it, that's the whole vibe check. ๐ฆ
Added in version 1.39.0.
int uv_udp_recv_stop(uv_udp_t *handle)
Stop listening for incoming datagrams. Like putting your phone on do-not-disturb, but for packets. ๐
Parameters
- handle โ UDP handle. Should have been initialized with
uv_udp_init().
Returns โ 0 on success, or an error code < 0 on failure.
size_t uv_udp_get_send_queue_size(const uv_udp_t *handle)
Returns handle->send_queue_size. Literally just hands you that field. ๐
Added in version 1.19.0.
size_t uv_udp_get_send_queue_count(const uv_udp_t *handle)
Returns handle->send_queue_count. Same energy, different field. โจ
Added in version 1.19.0.
See also
The uv_handle_t API functions also apply. ๐ซถ
๐ฆ uv_fs_event_t --- FS Event handle
FS Event handles let you monitor a given path for changes โ like, say, the file got renamed, or there was some generic change in it. This handle uses the best backend for the job on each platform. Iconic behaviour honestly. ๐
Note: on AIX, the non-default IBMbos.ahafspackage has to be installed. The AIX Event Infrastructure file system (ahafs) has some limitations, and they are real: -ahafstracks monitoring per process and is not thread safe. A separate process must be spawned for each monitor for the same event. - Events for file modification (writing to a file) are not received if only the containing folder is watched. See documentation (https://www.ibm.com/docs/en/aix/7.2?topic=management-aix-event-infrastructure-aix-aix-clusters-ahafs) for more details.
Also: the z/OS file system events monitoring infrastructure does not notify of file creation/deletion within a directory that is being monitored. See the IBM Knowledge centre (https://www.ibm.com/docs/en/zos/2.2.0?topic=SSLTBW_2.2.0/com.ibm.zos.v2r1.bpxb100/ioc.html) for more details. ๐ญ
Data types
type uv_fs_event_t โ FS Event handle type. Simple as that. ๐
typedef void (*uv_fs_event_cb)(uv_fs_event_t *handle, const char *filename, int events, int status)
The callback you pass to uv_fs_event_start(), which will be called repeatedly after the handle is started. It just keeps showing up. main character energy. ๐
If the handle was started with a directory, the filename parameter will be a relative path to a file contained in the directory, or NULL if the file name cannot be determined.
The events parameter is an ORed mask of uv_fs_event elements.
Note: for FreeBSD, path could sometimes be NULL due to a kernel bug. Not your fault, bestie. ๐
enum uv_fs_event โ event types that uv_fs_event_t handles monitor.
enum uv_fs_event {
UV_RENAME = 1,
UV_CHANGE = 2
};
enum uv_fs_event_flags โ flags you can pass to uv_fs_event_start() to control its behavior.
enum uv_fs_event_flags {
/*
* By default, if the fs event watcher is given a directory name, we will
* watch for all events in that directory. This flags overrides this behavior
* and makes fs_event report only changes to the directory entry itself. This
* flag does not affect individual files watched.
* This flag is currently not implemented yet on any backend.
*/
UV_FS_EVENT_WATCH_ENTRY = 1,
/*
* By default uv_fs_event will try to use a kernel interface such as inotify
* or kqueue to detect events. This may not work on remote file systems such
* as NFS mounts. This flag makes fs_event fall back to calling stat() on a
* regular interval.
* This flag is currently not implemented yet on any backend.
*/
UV_FS_EVENT_STAT = 2,
/*
* By default, event watcher, when watching directory, is not registering
* (is ignoring) changes in its subdirectories.
* This flag will override this behaviour on platforms that support it.
*/
UV_FS_EVENT_RECURSIVE = 4
};
Public members
N/A โ there are none. Shocking, I know. ๐
See also
The uv_handle_t members also apply.
API
int uv_fs_event_init(uv_loop_t *loop, uv_fs_event_t *handle)
Initialize the handle. That's the whole task. slay. โจ
int uv_fs_event_start(uv_fs_event_t *handle, uv_fs_event_cb cb, const char *path, unsigned int flags)
Start the handle with the given callback, which will watch the specified path for changes. flags can be an ORed mask of uv_fs_event_flags. Obsessed with how simple that is. ๐
Note: currently the only supported flag is UV_FS_EVENT_RECURSIVE, and only on OSX and Windows. Yeah. Only those two. ๐ญ
Note: on macOS, events collected by the OS immediately before callinguv_fs_event_startmight be reported to theuv_fs_event_cbcallback. Sneaky little time-travellers. ๐
int uv_fs_event_stop(uv_fs_event_t *handle)
Stop the handle โ the callback will no longer be called. Bye bestie, you're unsubscribed. ๐
int uv_fs_event_getpath(uv_fs_event_t *handle, char *buffer, size_t *size)
Get the path being monitored by the handle. The buffer must be preallocated by you, the user. Returns 0 on success or an error code < 0 in case of failure. On success, buffer will contain the path and size its length. If the buffer is not big enough, UV_ENOBUFS will be returned and size will be set to the required size, including the null terminator. ๐ธ
Changed in version 1.3.0: the returned length no longer includes the terminating null byte, and the buffer is not null terminated. glow-up but also lowkey chaotic.
Changed in version 1.9.0: the returned length includes the terminating null byte on UV_ENOBUFS, and the buffer is null terminated on success. fixed fr fr. ๐ซถ
See also
The uv_handle_t API functions also apply.
๐ uv_fs_poll_t --- FS Poll handle
FS Poll handles let you monitor a given path for changes. Unlike uv_fs_event_t, fs poll handles use stat to detect when a file has changed โ so they can work on file systems where fs event handles can't. Different technique, same goal. iconique. ๐
Data types
type uv_fs_poll_t โ FS Poll handle type. ๐
typedef void (*uv_fs_poll_cb)(uv_fs_poll_t *handle, int status, const uv_stat_t *prev, const uv_stat_t *curr)
The callback passed to uv_fs_poll_start(), which will be called repeatedly after the handle is started, whenever any change happens to the monitored path. ๐ฆ
The callback is invoked with status < 0 if path does not exist or is inaccessible. The watcher is not stopped, but your callback is not called again until something changes (e.g. when the file is created or the error reason changes). So like... it's waiting, not ghosting. ๐
When status == 0, the callback receives pointers to the old and new uv_stat_t structs. They are valid for the duration of the callback only โ do not go saving those pointers for later, bestie, that's a one-night-only performance. ๐ญ
Public members
N/A โ nothing here. ๐
See also
The uv_handle_t members also apply.
API
int uv_fs_poll_init(uv_loop_t *loop, uv_fs_poll_t *handle)
Initialize the handle. โจ
int uv_fs_poll_start(uv_fs_poll_t *handle, uv_fs_poll_cb poll_cb, const char *path, unsigned int interval)
Check the file at path for changes every interval milliseconds. Yes, milliseconds. Yes, it really does that. ๐
Note: for maximum portability, use multi-second intervals. Sub-second intervals will not detect all changes on many file systems. That's not a vibe, that's just how it is. ๐
int uv_fs_poll_stop(uv_fs_poll_t *handle)
Stop the handle โ the callback will no longer be called. periodt. ๐
int uv_fs_poll_getpath(uv_fs_poll_t *handle, char *buffer, size_t *size)
Get the path being monitored by the handle. The buffer must be preallocated by the user. Returns 0 on success or an error code < 0 in case of failure. On success, buffer will contain the path and size its length. If the buffer is not big enough, UV_ENOBUFS will be returned and size will be set to the required size. ๐ธ
Changed in version 1.3.0: the returned length no longer includes the terminating null byte, and the buffer is not null terminated.
Changed in version 1.9.0: the returned length includes the terminating null byte on UV_ENOBUFS, and the buffer is null terminated on success. ๐ซถ
See also
The uv_handle_t API functions also apply.
๐ File system operations
libuv provides a wide variety of cross-platform sync and async file system operations, and honestly? She ate. ๐ฅ
All functions defined in this document take a callback, which is allowed to be NULL. If the callback is NULL, the request is completed synchronously; otherwise it will be performed asynchronously. Choose your own adventure. โญ
All file operations are run on the threadpool. See Thread pool work scheduling (#threadpool) for the info on the threadpool size โ because yes, there's a size, and yes, it matters. ๐
Starting with libuv v1.45.0, some file operations on Linux get handed off to io_uring whenever it's possible. Bestie, literally the only observable difference is a (sometimes huge) glow-up in throughput โ nothing else changes, no cap. Libuv falls back to its trusty threadpool when the kernel features it needs are unavailable or just not it. Then starting with libuv v1.49.0 this whole thing got reverted, so Libuv on Linux is back to using the threadpool by default. Wanna turn io_uring on anyway? Then you gotta configure that uv_loop_t <#c.uv_loop_t> instance with the UV_LOOP_USE_IO_URING_SQPOLL option. ๐
Note: On Windows, uv_fs_* functions use utf-8 encoding. ๐ซถ
๐ฆ Data types ๐ฆ
type uv_fs_tโ the file system request type. Your main character struct, fr.type uv_timespec_tโ a Y2K38-unsafe data type for storing times with nanosecond resolution. It's getting replaced withuv_timespec64_t<#c.uv_timespec64_t> in libuv v2.0, so likeโฆ enjoy it while it lasts ๐
typedef struct {
long tv_sec;
long tv_nsec;
} uv_timespec_t;
type uv_stat_tโ the portable equivalent ofstruct stat. Slay, cross-platform queen โจ
typedef struct {
uint64_t st_dev;
uint64_t st_mode;
uint64_t st_nlink;
uint64_t st_uid;
uint64_t st_gid;
uint64_t st_rdev;
uint64_t st_ino;
uint64_t st_size;
uint64_t st_blksize;
uint64_t st_blocks;
uint64_t st_flags;
uint64_t st_gen;
uv_timespec_t st_atim;
uv_timespec_t st_mtim;
uv_timespec_t st_ctim;
uv_timespec_t st_birthtim;
} uv_stat_t;
enum uv_fs_typeโ the file system request type. Yeah, same description as above, it's giving "the same but an enum". Here's the whole lineup, every single one, no skipping ๐
typedef enum {
UV_FS_UNKNOWN = -1,
UV_FS_CUSTOM,
UV_FS_OPEN,
UV_FS_CLOSE,
UV_FS_READ,
UV_FS_WRITE,
UV_FS_SENDFILE,
UV_FS_STAT,
UV_FS_LSTAT,
UV_FS_FSTAT,
UV_FS_FTRUNCATE,
UV_FS_UTIME,
UV_FS_FUTIME,
UV_FS_ACCESS,
UV_FS_CHMOD,
UV_FS_FCHMOD,
UV_FS_FSYNC,
UV_FS_FDATASYNC,
UV_FS_UNLINK,
UV_FS_RMDIR,
UV_FS_MKDIR,
UV_FS_MKDTEMP,
UV_FS_RENAME,
UV_FS_SCANDIR,
UV_FS_LINK,
UV_FS_SYMLINK,
UV_FS_READLINK,
UV_FS_CHOWN,
UV_FS_FCHOWN,
UV_FS_REALPATH,
UV_FS_COPYFILE,
UV_FS_LCHOWN,
UV_FS_OPENDIR,
UV_FS_READDIR,
UV_FS_CLOSEDIR,
UV_FS_MKSTEMP,
UV_FS_LUTIME
} uv_fs_type;
type uv_statfs_tโ a reduced, cross-platform equivalent ofstruct statfs. It gets used inuv_fs_statfs(). ๐
typedef struct uv_statfs_s {
uint64_t f_type;
uint64_t f_bsize;
uint64_t f_blocks;
uint64_t f_bfree;
uint64_t f_bavail;
uint64_t f_files;
uint64_t f_ffree;
uint64_t f_frsize;
uint64_t f_spare[3];
} uv_statfs_t;
enum uv_dirent_type_tโ the type of dirent. Lowkey self-explanatory, highkey useful ๐
typedef enum {
UV_DIRENT_UNKNOWN,
UV_DIRENT_FILE,
UV_DIRENT_DIR,
UV_DIRENT_LINK,
UV_DIRENT_FIFO,
UV_DIRENT_SOCKET,
UV_DIRENT_CHAR,
UV_DIRENT_BLOCK
} uv_dirent_type_t;
type uv_dirent_tโ the cross-platform (reduced) equivalent ofstruct dirent. Used inuv_fs_scandir_next(). Isn't she neat ๐
typedef struct uv_dirent_s {
const char* name;
uv_dirent_type_t type;
} uv_dirent_t;
type uv_dir_tโ the data type for streaming directory iteration. Used byuv_fs_opendir(),uv_fs_readdir(), anduv_fs_closedir(). Okay so quick breakdown:direntsrepresents a user provided array ofuv_dirent_ts used to hold results, andnentriesis the user provided maximum array size ofdirents. You bring the storage, bestie โ libuv just fills it ๐
typedef struct uv_dir_s {
uv_dirent_t* dirents;
size_t nentries;
} uv_dir_t;
typedef void (*uv_fs_cb)(uv_fs_t *req)โ the callback that gets called when a request is completed asynchronously. Your little "it's done!!" notification ๐ฆ
๐ธ Public members ๐ธ
uv_loop_t *uv_fs_t.loopโ the loop that started this request and where completion will be reported. Readonly, so don't even try it ๐uv_fs_type uv_fs_t.fs_typeโ the FS request type.const char *uv_fs_t.pathโ the path affecting the request.ssize_t uv_fs_t.resultโ the result of the request.< 0means error, success otherwise. On requests likeuv_fs_read()oruv_fs_write()it tells you the amount of data that was read or written, respectively. Basically the receipts ๐ฅuv_stat_t uv_fs_t.statbufโ stores the result ofuv_fs_stat()and other stat requests.void *uv_fs_t.ptrโ stores the result ofuv_fs_readlink()anduv_fs_realpath(), and serves as an alias tostatbuf. Multi-purpose icon ๐
See also: the uv_req_t <#c.uv_req_t> members also apply. Don't forget them, iykyk.
โญ API โญ
void uv_fs_req_cleanup(uv_fs_t *req)
Cleanup request. You must call this after a request is finished so libuv can deallocate any memory it might have allocated. Not optional, bestie โ it's the "please clear the table" of libuv ๐งนโจ
int uv_fs_close(uv_loop_t *loop, uv_fs_t *req, uv_file file, uv_fs_cb cb)
Equivalent to close(2) (yes, that one, over on the Linux man-pages at man7.org).
int uv_fs_open(uv_loop_t *loop, uv_fs_t *req, const char *path, int flags, int mode, uv_fs_cb cb)
Equivalent to open(2).
Note: On Windows, libuv usesCreateFileWand thus the file is always opened in binary mode. Because of this, theO_BINARYandO_TEXTflags are not supported. Not me finding out the hard way ๐ญ
int uv_fs_read(uv_loop_t *loop, uv_fs_t *req, uv_file file, const uv_buf_t bufs[], unsigned int nbufs, int64_t offset, uv_fs_cb cb)
Equivalent to preadv(2). If the offset argument is -1, then the current file offset is used and updated. Little detail, big consequences ๐
Warning: On Windows, under non-MSVC environments (e.g. when GCC or Clang is used to build libuv), files opened using UV_FS_O_FILEMAP may cause a fatal crash if the memory mapped read operation fails. Fr fr, be careful ๐
int uv_fs_unlink(uv_loop_t *loop, uv_fs_t *req, const char *path, uv_fs_cb cb)
Equivalent to unlink(2).
int uv_fs_write(uv_loop_t *loop, uv_fs_t *req, uv_file file, const uv_buf_t bufs[], unsigned int nbufs, int64_t offset, uv_fs_cb cb)
Equivalent to pwritev(2). If the offset argument is -1, then the current file offset is used and updated. Same deal as read ๐ซถ
Warning: On Windows, under non-MSVC environments (e.g. when GCC or Clang is used to build libuv), files opened using UV_FS_O_FILEMAP may cause a fatal crash if the memory mapped write operation fails. Same warning, write edition โ it's giving dรฉjร vu ๐
int uv_fs_mkdir(uv_loop_t *loop, uv_fs_t *req, const char *path, int mode, uv_fs_cb cb)
Equivalent to mkdir(2).
Note: mode is currently not implemented on Windows. Windows said "no thanks" ๐
int uv_fs_mkdtemp(uv_loop_t *loop, uv_fs_t *req, const char *tpl, uv_fs_cb cb)
Equivalent to mkdtemp(3). The result can be found as a null terminated string at req->path. Cute, it tells you where it put the directory ๐
int uv_fs_mkstemp(uv_loop_t *loop, uv_fs_t *req, const char *tpl, uv_fs_cb cb)
Equivalent to mkstemp(3). The created file path can be found as a null terminated string at req->path, and the file descriptor can be found as an integer at req->result. Two-for-one, we love to see it ๐
Added in version 1.34.0.
int uv_fs_rmdir(uv_loop_t *loop, uv_fs_t *req, const char *path, uv_fs_cb cb)
Equivalent to rmdir(2).
int uv_fs_opendir(uv_loop_t *loop, uv_fs_t *req, const char *path, uv_fs_cb cb)
Opens path as a directory stream. On success, a uv_dir_t is allocated and returned via req->ptr. Okay, crucial thing: this memory is NOT freed by uv_fs_req_cleanup(), even though req->ptr gets set to NULL. You have to free that allocated memory yourself by calling uv_fs_closedir(). On failure, no memory is allocated. Don't leak, bestie, it's not the vibe ๐ญ๐ง
The contents of the directory can be iterated over by passing the resulting uv_dir_t to uv_fs_readdir().
Added in version 1.28.0.
int uv_fs_closedir(uv_loop_t *loop, uv_fs_t *req, uv_dir_t *dir, uv_fs_cb cb)
Closes the directory stream represented by dir and frees the memory allocated by uv_fs_opendir(). The circle is complete, the memory is released, we love a clean exit ๐
Added in version 1.28.0.
int uv_fs_readdir(uv_loop_t *loop, uv_fs_t *req, uv_dir_t *dir, uv_fs_cb cb)
Iterates over the directory stream dir returned by a successful uv_fs_opendir() call. Before you invoke uv_fs_readdir(), the caller must set dir->dirents and dir->nentries, representing the array of uv_dirent_t elements used to hold the read directory entries and its size. You set up the lil bucket, libuv pours the entries in ๐
On success, the result is an integer >= 0 representing the number of entries read from the stream. Zero means you're at the end, so don't panic ๐ฅ
Added in version 1.28.0.
Warning: uv_fs_readdir() is not thread safe. Like, do not share it across threads, bestie, I'm serious ๐ญ
Note: This function does not return the"."and".."entries. So don't go looking for them, they're not invited to this party ๐
Note: On success this function allocates memory that must be freed usinguv_fs_req_cleanup(). Anduv_fs_req_cleanup()must be called before closing the directory withuv_fs_closedir(). Order matters, okay? ๐ซถ
int uv_fs_scandir(uv_loop_t *loop, uv_fs_t *req, const char *path, int flags, uv_fs_cb cb)
int uv_fs_scandir_next(uv_fs_t *req, uv_dirent_t *ent)
Okay so uv_fs_scandir_next() is basically the same energy as scandir(3) โ here's the man page if you wanna peek: https://man7.org/linux/man-pages/man3/scandir.3.html โ but the API is slightly different, because of course it is โจ
Once the callback for the request gets called, you can use uv_fs_scandir_next() to get ent populated with the next directory entry's data. When there are no more entries, UV_EOF will be returned. That's the "we're done here" signal ๐
Note: Unlikescandir(3), this function does not return the"."and".."entries. Again. They are not coming. Accept it ๐
Note: On Linux, getting the type of an entry is only supported by some file systems โ at the time of this writing:btrfs,ext2,ext3andext4. Check thegetdents(2)man page for the full tea:https://man7.org/linux/man-pages/man2/getdents.2.html๐
int uv_fs_stat(uv_loop_t *loop, uv_fs_t *req, const char *path, uv_fs_cb cb)
int uv_fs_fstat(uv_loop_t *loop, uv_fs_t *req, uv_file file, uv_fs_cb cb)
int uv_fs_lstat(uv_loop_t *loop, uv_fs_t *req, const char *path, uv_fs_cb cb)
These three are equivalent to stat(2), fstat(2) and lstat(2) respectively. Respectively is doing a lot of work there, but slay ๐
Man pages for the curious: https://man7.org/linux/man-pages/man2/stat.2.html https://man7.org/linux/man-pages/man2/fstat.2.html https://man7.org/linux/man-pages/man2/lstat.2.html
int uv_fs_statfs(uv_loop_t *loop, uv_fs_t *req, const char *path, uv_fs_cb cb)
Equivalent to statfs(2) โ yep, here's the link: https://man7.org/linux/man-pages/man2/statfs.2.html โจ
On success, a uv_statfs_t is allocated and returned via req->ptr. This memory is freed by uv_fs_req_cleanup(). So yeah, cleanup is your bestie, don't ghost it ๐ซถ
Note: Any fields in the resulting uv_statfs_t that are not supported by the underlying operating system are set to zero. No cap, they just zero out ๐ง
Added in version 1.31.0. ๐
int uv_fs_rename(uv_loop_t *loop, uv_fs_t *req, const char *path, const char *new_path, uv_fs_cb cb)
Equivalent to rename(2). Link for the lore: https://man7.org/linux/man-pages/man2/rename.2.html ๐ฆ
int uv_fs_fsync(uv_loop_t *loop, uv_fs_t *req, uv_file file, uv_fs_cb cb)
Equivalent to fsync(2). Here's the man page: https://man7.org/linux/man-pages/man2/fsync.2.html ๐ธ
Note: For AIX,uv_fs_fsyncreturnsUV_EBADFon file descriptors referencing non regular files. AIX said "not today" ๐
int uv_fs_fdatasync(uv_loop_t *loop, uv_fs_t *req, uv_file file, uv_fs_cb cb)
Equivalent to fdatasync(2). Link: https://man7.org/linux/man-pages/man2/fdatasync.2.html โญ
int uv_fs_ftruncate(uv_loop_t *loop, uv_fs_t *req, uv_file file, int64_t offset, uv_fs_cb cb)
Equivalent to ftruncate(2). Link: https://man7.org/linux/man-pages/man2/ftruncate.2.html ๐
int uv_fs_copyfile(uv_loop_t *loop, uv_fs_t *req, const char *path, const char *new_path, int flags, uv_fs_cb cb)
Copies a file from path to new_path. The supported flags are giving very much "choose your fighter" and they're described below ๐
UV_FS_COPYFILE_EXCLโ If present,uv_fs_copyfile()will fail withUV_EEXISTif the destination path already exists. The default behavior is to overwrite the destination if it exists. So if you want it to be exclusive, say it with your chest ๐UV_FS_COPYFILE_FICLONEโ If present,uv_fs_copyfile()will attempt to create a copy-on-write reflink. If the underlying platform does not support copy-on-write, or an error occurs while attempting to use copy-on-write, a fallback copy mechanism based onuv_fs_sendfile()is used. Lowkey resilient ๐ฆUV_FS_COPYFILE_FICLONE_FORCEโ If present,uv_fs_copyfile()will attempt to create a copy-on-write reflink. If the underlying platform does not support copy-on-write, or an error occurs while attempting to use copy-on-write, then an error is returned. No fallback, no backup plan, just vibes and consequences ๐ญ
Warning: If the destination path is created, but an error occurs while copying the data, then the destination path is removed. There is a brief window of time between closing and removing the file where another process could access the file. So yeah, tiny race window, keep that in mind, bestie ๐ซถ
Added in version 1.14.0.
Changed in version 1.20.0: UV_FS_COPYFILE_FICLONE and UV_FS_COPYFILE_FICLONE_FORCE are supported.
Changed in version 1.33.0: If an error occurs while using UV_FS_COPYFILE_FICLONE_FORCE, that error is returned. Previously, all errors were mapped to UV_ENOTSUP. Glow-up behavior โจ
int uv_fs_sendfile(uv_loop_t *loop, uv_fs_t *req, uv_file out_fd, uv_file in_fd, int64_t in_offset, size_t length, uv_fs_cb cb)
Limited equivalent to sendfile(2). Link: https://man7.org/linux/man-pages/man2/sendfile.2.html ๐
int uv_fs_access(uv_loop_t *loop, uv_fs_t *req, const char *path, int mode, uv_fs_cb cb)
Equivalent to access(2) on Unix. Windows uses GetFileAttributesW(). Platform differences, classic ๐
Link: https://man7.org/linux/man-pages/man2/access.2.html ๐
int uv_fs_chmod(uv_loop_t *loop, uv_fs_t *req, const char *path, int mode, uv_fs_cb cb)
int uv_fs_fchmod(uv_loop_t *loop, uv_fs_t *req, uv_file file, int mode, uv_fs_cb cb)
Equivalent to chmod(2) and fchmod(2) respectively. Respectively again, iconic ๐
Links: https://man7.org/linux/man-pages/man2/chmod.2.html https://man7.org/linux/man-pages/man2/fchmod.2.html
int uv_fs_utime(uv_loop_t *loop, uv_fs_t *req, const char *path, double atime, double mtime, uv_fs_cb cb)
int uv_fs_futime(uv_loop_t *loop, uv_fs_t *req, uv_file file, double atime, double mtime, uv_fs_cb cb)
int uv_fs_lutime(uv_loop_t *loop, uv_fs_t *req, const char *path, double atime, double mtime, uv_fs_cb cb)
Equivalent to utime(2), futimes(3) and lutimes(3) respectively. Timestamp besties ๐
Links: https://man7.org/linux/man-pages/man2/utime.2.html https://man7.org/linux/man-pages/man3/futimes.3.html https://man7.org/linux/man-pages/man3/lutimes.3.html
Passing UV_FS_UTIME_NOW as the atime or mtime sets the timestamp to the current time. "Now" means now, periodt โฐ
Passing UV_FS_UTIME_OMIT as the atime or mtime leaves the timestamp untouched. Leave it alone, it's fine ๐
Note: z/OS:uv_fs_lutime()is not implemented for z/OS. It can still be called but will returnUV_ENOSYS. So it exists, but it's not doing the thing ๐ญ
Note: AIX:uv_fs_futime()anduv_fs_lutime()functions only work for AIX 7.1 and newer. They can still be called on older versions but will returnUV_ENOSYS. AIX said "version check, babe" ๐
Changed in version 1.10.0: sub-second precission is supported on Windows. Yes, "precission" โ that's the spelling in the original, don't come for me ๐
int uv_fs_link(uv_loop_t *loop, uv_fs_t *req, const char *path, const char *new_path, uv_fs_cb cb)
Equivalent to link(2). Link: https://man7.org/linux/man-pages/man2/link.2.html ๐ฅ
int uv_fs_symlink(uv_loop_t *loop, uv_fs_t *req, const char *path, const char *new_path, int flags, uv_fs_cb cb)
Equivalent to symlink(2). Link: https://man7.org/linux/man-pages/man2/symlink.2.html ๐ฆ
Note: On Windows the flags parameter can be specified to control how the symlink will be created:
UV_FS_SYMLINK_DIRโ indicates thatpathpoints to a directory. Directory energy ๐UV_FS_SYMLINK_JUNCTIONโ request that the symlink is created using junction points. Junction points, fancy ๐
int uv_fs_readlink(uv_loop_t *loop, uv_fs_t *req, const char *path, uv_fs_cb cb)
Equivalent to readlink(2). Link: https://man7.org/linux/man-pages/man2/readlink.2.html โจ
The resulting string is stored in req->ptr. So that's where the magic lives ๐
int uv_fs_realpath(uv_loop_t *loop, uv_fs_t *req, const char *path, uv_fs_cb cb)
Equivalent to realpath(3) on Unix. Windows uses GetFinalPathNameByHandleW โ link if you're nosy: https://learn.microsoft.com/en-us/windows/win32/api/fileapi/nf-fileapi-getfinalpathnamebyhandlew ๐ธ
The resulting string is stored in req->ptr. Same spot as readlink, cute ๐
Warning: This function has certain platform-specific caveats that were discovered when used in Node. Not me being dramatic, this is literally in the notes ๐ญ
- macOS and other BSDs: this function will fail with
UV_ELOOPif more than 32 symlinks are found while resolving the given path. This limit is hardcoded and cannot be sidestepped. Thirty-two. That's the number. No negotiating ๐ - Windows: while this function works in the common case, there are a number of corner cases where it doesn't:
- Paths in ramdisk volumes created by tools which sidestep the Volume Manager (such as ImDisk) cannot be resolved.
- Inconsistent casing when using drive letters.
- Resolved path bypasses subst'd drives.
While this function can still be used, it's not recommended if scenarios such as the above need to be supported. So like, use it, but know the limits, bestie ๐ซถ
The background story and some more details on these issues can be checked here: https://github.com/nodejs/node/issues/7726 ๐
Added in version 1.8.0.
int uv_fs_chown(uv_loop_t *loop, uv_fs_t *req, const char *path, uv_uid_t uid, uv_gid_t gid, uv_fs_cb cb)
int uv_fs_fchown(uv_loop_t *loop, uv_fs_t *req, uv_file file, uv_uid_t uid, uv_gid_t gid, uv_fs_cb cb)
Ownership change besties, uid and gid and all that ๐
int uv_fs_lchown(uv_loop_t *loop, uv_fs_t *req, const char *path, uv_uid_t uid, uv_gid_t gid, uv_fs_cb cb)โ bestie this is the ownership-change squad ๐ it's equivalent tochown(2),fchown(2)andlchown(2)respectively.
Note: these functions are not implemented on Windows ๐ซ๐ช
Changed in version 1.21.0: uv_fs_lchown got implemented. slay.
uv_fs_type uv_fs_get_type(const uv_fs_t *req)โ hands you backreq->fs_type. that's it, that's the whole vibe โจ
Added in version 1.19.0.
ssize_t uv_fs_get_result(const uv_fs_t *req)โ returnsreq->result. short king of a getter ๐ซถ
Added in version 1.19.0.
int uv_fs_get_system_error(const uv_fs_t *req)โ gives you the platform-specific error code: that's theGetLastError()value on Windows, and-(req->result)everywhere else ๐ช๐๐ง
Added in version 1.19.0. (no wait โ Added in version 1.38.0, my bad ๐)
void *uv_fs_get_ptr(const uv_fs_t *req)โ returnsreq->ptr. pointer reveal ๐
Added in version 1.19.0.
const char *uv_fs_get_path(const uv_fs_t *req)โ returnsreq->path. the path is giving main character energy ๐
Added in version 1.19.0.
uv_stat_t *uv_fs_get_statbuf(uv_fs_t *req)โ returns&req->statbuf. literally just the address, no cap โจ
Added in version 1.19.0.
See also: the uv_req_t API functions also apply ๐ซถ
๐ ๏ธ Helper functions ๐ ๏ธ
uv_os_fd_t uv_get_osfhandle(int fd)โ you hand it a file descriptor from the C runtime, and it gives you back the OS-dependent handle. On UNIX it returns thefdintact, untouched, iconic. On Windows it calls_get_osfhandle(https://learn.microsoft.com/en-us/cpp/c-runtime-library/reference/get-osfhandle?view=vs-2019).
ngl this is the important part: the return value is still owned by the C runtime, so any attempts tocloseit or to use it after closing thefdmay lead to malfunction ๐ญ don't do it bestie.
Added in version 1.12.0.
int uv_open_osfhandle(uv_os_fd_t os_fd)โ the reverse situation ๐ give it an OS-dependent handle and it gives you the file descriptor in the C runtime. On UNIX it returns theos_fdintact. On Windows it calls_open_osfhandle(https://learn.microsoft.com/en-us/cpp/c-runtime-library/reference/open-osfhandle?view=vs-2019).
and fr fr, this one consumes the argument, so any attempts to close it or to use it after closing the return value may lead to malfunction ๐
Added in version 1.23.0.
๐ช File open constants ๐ช
UV_FS_O_APPENDโ file opens in append mode. before every single write, the file offset gets moved to the end of the file. periodt. ๐UV_FS_O_CREATโ the file gets created if it doesn't already exist. baby's first file ๐ฃUV_FS_O_DIRECTโ file I/O goes directly to and from user-space buffers, which must be aligned. buffer size and address should be a multiple of the physical sector size of the block device. we love an alignment queen ๐
Note:UV_FS_O_DIRECTis supported on Linux, and on Windows viaFILE_FLAG_NO_BUFFERING(https://learn.microsoft.com/en-us/windows/win32/fileio/file-buffering).UV_FS_O_DIRECTis not supported on macOS ๐๐
UV_FS_O_DIRECTORYโ if the path isn't a directory, fail the open. no imposters allowed ๐ซ
Note: UV_FS_O_DIRECTORY is not supported on Windows.
UV_FS_O_DSYNCโ file opens for synchronous I/O. write operations complete once all data and a minimum of metadata are flushed to disk. lowkey thorough ๐พ
Note:UV_FS_O_DSYNCis supported on Windows viaFILE_FLAG_WRITE_THROUGH(https://learn.microsoft.com/en-us/windows/win32/fileio/file-buffering).
UV_FS_O_EXCLโ if theO_CREATflag is set and the file already exists, fail the open. exclusive much? ๐
Note: in general, the behavior ofO_EXCLis undefined if it's used withoutO_CREAT๐ฌ there is one exception though: on Linux 2.6 and later,O_EXCLcan be used withoutO_CREATifpathnamerefers to a block device. if the block device is in use by the system (e.g., mounted), the open will fail with the errorEBUSY.
UV_FS_O_EXLOCKโ atomically obtain an exclusive lock. lock it down ๐
Note: UV_FS_O_EXLOCK is only supported on macOS and Windows.
Changed in version 1.17.0: support is added for Windows.
UV_FS_O_FILEMAPโ use a memory file mapping to access the file. when you use this flag, the file cannot be open multiple times concurrently ๐จ
Note: UV_FS_O_FILEMAP is only supported on Windows.
UV_FS_O_NOATIMEโ don't update the file access time when the file is read. time is fake anyway โฐโจ
Note: UV_FS_O_NOATIME is not supported on Windows.
UV_FS_O_NOCTTYโ if the path identifies a terminal device, opening that path will not cause the terminal to become the controlling terminal for the process (if the process doesn't already have one). no stealing the spotlight ๐
Note: UV_FS_O_NOCTTY is not supported on Windows.
UV_FS_O_NOFOLLOWโ if the path is a symbolic link, fail the open. we don't follow, we lead ๐ฆ
Note: UV_FS_O_NOFOLLOW is not supported on Windows.
UV_FS_O_NONBLOCKโ open the file in nonblocking mode if possible. no waiting around ๐จ
Note: UV_FS_O_NONBLOCK is not supported on Windows.
UV_FS_O_RANDOMโ access is intended to be random. the system can use this as a hint to optimize file caching. chaos but make it efficient ๐ฒ
Note:UV_FS_O_RANDOMis only supported on Windows viaFILE_FLAG_RANDOM_ACCESS(https://learn.microsoft.com/en-us/windows/win32/api/fileapi/nf-fileapi-createfilew).
UV_FS_O_RDONLYโ open the file for read-only access. look, don't touch ๐UV_FS_O_RDWRโ open the file for read-write access. touch and look, both ๐UV_FS_O_SEQUENTIALโ access is intended to be sequential from beginning to end. the system can use this as a hint to optimize file caching. start to finish, no detours ๐
Note:UV_FS_O_SEQUENTIALis only supported on Windows viaFILE_FLAG_SEQUENTIAL_SCAN(https://learn.microsoft.com/en-us/windows/win32/api/fileapi/nf-fileapi-createfilew).
UV_FS_O_SHORT_LIVEDโ the file is temporary and should not be flushed to disk if possible. here for a short time, not a long time ๐ง
Note:UV_FS_O_SHORT_LIVEDis only supported on Windows viaFILE_ATTRIBUTE_TEMPORARY(https://learn.microsoft.com/en-us/windows/win32/api/fileapi/nf-fileapi-createfilew).
UV_FS_O_SYMLINKโ open the symbolic link itself rather than the resource it points to. the link is the moment ๐UV_FS_O_SYNCโ file opens for synchronous I/O. write operations complete once all data and all metadata are flushed to disk. the full send ๐พ๐ฅ
Note:UV_FS_O_SYNCis supported on Windows viaFILE_FLAG_WRITE_THROUGH(https://learn.microsoft.com/en-us/windows/win32/fileio/file-buffering).
UV_FS_O_TEMPORARYโ the file is temporary and should not be flushed to disk if possible. (yes, this is basically twins withUV_FS_O_SHORT_LIVED, don't come for me ๐ญ)
Note:UV_FS_O_TEMPORARYis only supported on Windows viaFILE_ATTRIBUTE_TEMPORARY(https://learn.microsoft.com/en-us/windows/win32/api/fileapi/nf-fileapi-createfilew).
UV_FS_O_TRUNCโ if the file exists and is a regular file, and the file is opened successfully for write access, its length shall be truncated to zero. bye bye content โ๏ธUV_FS_O_WRONLYโ open the file for write-only access. speak, don't listen ๐ฃ๏ธ
๐งต Thread pool work scheduling ๐งต
okay so libuv gives you a threadpool ๐ซถ you can use it to run your own code and get notified back on the loop thread. this pool is used internally for all the file system operations, plus getaddrinfo and getnameinfo requests. it's doing a lot, basically.
its default size is 4, but you can change it at startup time by setting the UV_THREADPOOL_SIZE environment variable to any value (the absolute maximum is 1024). โจ
Changed in version 1.30.0: the maximum UV_THREADPOOL_SIZE allowed was increased from 128 to 1024. glow up ๐
Changed in version 1.45.0: threads now have an 8 MB stack instead of the (sometimes too low) platform default. room to breathe ๐ฌ๏ธ
Changed in version 1.50.0: threads now have a default name of libuv-worker. they have names now, we stan ๐
the threadpool is global and shared across all event loops. when a particular function makes use of the threadpool (e.g. when using uv_queue_work()), libuv preallocates and initializes the maximum number of threads allowed by UV_THREADPOOL_SIZE. more threads usually means more throughput but a higher memory footprint. thread stacks grow lazily on most platforms though, so no cap on the dramatics ๐
Note: even though a global thread pool shared across all event loops is used, the functions are not thread safe. fr fr, don't try it ๐ญ
๐ฆ Data types ๐ฆ
type uv_work_tโ work request type. that's the whole description bestie, it's a type ๐ซถtypedef void (*uv_work_cb)(uv_work_t *req)โ the callback you pass touv_queue_work(), which will be run on the thread pool. the pool girlies are on it ๐typedef void (*uv_after_work_cb)(uv_work_t *req, int status)โ the callback you pass touv_queue_work()which gets called on the loop thread after the work on the threadpool has been completed. if the work was cancelled usinguv_cancel(),statuswill beUV_ECANCELED๐ซ
๐ Public members ๐
uv_loop_t *uv_work_t.loopโ the loop that started this request and where completion will be reported. Readonly. no touching ๐
See also: the uv_req_t members also apply ๐ซถ
๐ API ๐
int uv_queue_work(uv_loop_t *loop, uv_work_t *req, uv_work_cb work_cb, uv_after_work_cb after_work_cb)โ initializes a work request which will run the givenwork_cbin a thread from the threadpool. oncework_cbis completed,after_work_cbwill be called on the loop thread. cute lil assembly line ๐ญโจ
this request can be cancelled with uv_cancel(). iconic escape hatch ๐
See also: the uv_req_t API functions also apply.
๐ DNS utility functions ๐
libuv provides asynchronous variants of getaddrinfo and getnameinfo. async queen behavior, no blocking on my watch โญ
๐ท๏ธ Data types ๐ท๏ธ
type uv_getaddrinfo_tโgetaddrinforequest type.typedef void (*uv_getaddrinfo_cb)(uv_getaddrinfo_t *req, int status, struct addrinfo *res)โ callback which will be called with thegetaddrinforequest result once complete. in case it was cancelled,statuswill have a value ofUV_ECANCELED๐ซ๐ฆtype uv_getnameinfo_tโgetnameinforequest type.typedef void (*uv_getnameinfo_cb)(uv_getnameinfo_t *req, int status, const char *hostname, const char *service)โ this is the callback that gets summoned the moment your getnameinfo request is done, bestie. It hands youreq,status,hostnameandservice. Oh and if the whole thing got cancelled? Thenstatuscomes back asUV_ECANCELED๐ so don't panic, that's just what canceled looks like.
๐งธ Public members
uv_loop_t *uv_getaddrinfo_t.loopโ the loop that kicked off this getaddrinfo request and where the completion gets reported back to you. Readonly, so hands off ๐ซถstruct addrinfo *uv_getaddrinfo_t.addrinfoโ pointer to astruct addrinfoholding the actual result. You must free this yourself withuv_freeaddrinfo(), no cap. Also: Changed in version 1.3.0: the field is declared as public โจuv_loop_t *uv_getnameinfo_t.loopโ the loop that started this getnameinfo request and where the completion gets reported. Readonly again, same energy ๐char[NI_MAXHOST] uv_getnameinfo_t.hostโ a char array holding the resulting host. It's null terminated, iconic behavior. Changed in version 1.3.0: the field is declared as public ๐ธchar[NI_MAXSERV] uv_getnameinfo_t.serviceโ char array holding the resulting service, also null terminated, also public since Changed in version 1.3.0 ๐
See also: the uv_req_t members apply here too, bestie ๐
๐ ๏ธ API
int uv_getaddrinfo(uv_loop_t *loop, uv_getaddrinfo_t *req, uv_getaddrinfo_cb getaddrinfo_cb, const char *node, const char *service, const struct addrinfo *hints)โ asynchronousgetaddrinfo(3), the async glow-up of the classic.
So like, either node or service can be NULL, but not both โ that's the one rule, don't break it ๐
hints is a pointer to a struct addrinfo with extra address type constraints, or NULL. Go consult man -s 3 getaddrinfo for the full lore.
Returns 0 on success or an error code < 0 on failure. If it worked, the callback gets called sometime in the future with the lookup result, which is literally either:
status == 0, and theresargument points to a validstruct addrinfo, orstatus < 0, and theresargument isNULL. Check theUV_EAI_*constants for what went down.
Call uv_freeaddrinfo() to free the addrinfo structure โ it's giving "you break it, you bought it" ๐
Changed in version 1.3.0: the callback parameter is now allowed to be NULL, and in that case the request will run synchronously. Yes bestie, sync mode, main character energy ๐ฅ
void uv_freeaddrinfo(struct addrinfo *ai)โ frees thestruct addrinfo. PassingNULLis allowed and is a total no-op, so honestly very forgiving of you ๐int uv_getnameinfo(uv_loop_t *loop, uv_getnameinfo_t *req, uv_getnameinfo_cb getnameinfo_cb, const struct sockaddr *addr, int flags)โ asynchronousgetnameinfo(3), the name-lookup cousin.
Returns 0 on success or an error code < 0 on failure. If it succeeded, the callback gets called sometime in the future with the lookup result. Consult man -s 3 getnameinfo for the details, iykyk.
Changed in version 1.3.0: the callback parameter is now allowed to be NULL, and in that case the request will run synchronously โจ
See also: the uv_req_t API functions apply here too ๐ซถ
๐ Shared library handling
libuv hooks you up with cross-platform utilities for loading shared libraries and pulling symbols out of them, using this API right here. Very "borrowing code from your friend's project" of it ๐
๐๏ธ Data types
type uv_lib_tโ the shared library data type. That's it, that's the whole thing.
๐งธ Public members
N/Aโ none. Nothing. Empty. The void. ๐ณ๏ธ
๐ ๏ธ API
int uv_dlopen(const char *filename, uv_lib_t *lib)โ opens a shared library.filenameis in utf-8. Returns0on success and-1on error. Then calluv_dlerror()to get the actual error message, because-1alone is not the vibe ๐ญvoid uv_dlclose(uv_lib_t *lib)โ closes the shared library. Closing time, you don't gotta go home but you can't stay here ๐int uv_dlsym(uv_lib_t *lib, const char *name, void **ptr)โ retrieves a data pointer from a dynamic library. Fun fact: it is legal for a symbol to map toNULLโ yes,NULLcan be a real answer, don't @ me. Returns0on success and-1if the symbol was not found ๐ธconst char *uv_dlerror(const uv_lib_t *lib)โ returns the lastuv_dlopen()oruv_dlsym()error message. Your receipts, basically ๐งพ
๐งต Threading and synchronization utilities
libuv gives you cross-platform implementations for a whole squad of threading and synchronization primitives. The API largely follows the pthreads API, so if you know that one you're already slaying ๐
๐๏ธ Data types
type uv_thread_tโ thread data type.typedef void (*uv_thread_cb)(void *arg)โ the callback invoked to initialize thread execution.argis the same value you passed touv_thread_create(), so it comes right back to you ๐ฆtype uv_key_tโ thread-local key data type.type uv_once_tโ once-only initializer data type.type uv_mutex_tโ mutex data type.type uv_rwlock_tโ read-write lock data type.type uv_sem_tโ semaphore data type.type uv_cond_tโ condition data type.type uv_barrier_tโ barrier data type.
๐ ๏ธ API
๐งต Threads
type uv_thread_options_tโ options for spawning a new thread, passed touv_thread_create_ex(). Here's the whole struct, keep it exact bestie:
typedef struct uv_thread_options_s {
enum {
UV_THREAD_NO_FLAGS = 0x00,
UV_THREAD_HAS_STACK_SIZE = 0x01
} flags;
size_t stack_size;
} uv_thread_options_t;
Heads up: more fields may be added to this struct at any time, so its exact layout and size should not be relied upon. It's giving "living document" ๐ซ
Added in version 1.26.0.
int uv_thread_create(uv_thread_t *tid, uv_thread_cb entry, void *arg)โ Changed in version 1.4.1: returns aUV_E*error code on failure. So now you actually get told what went wrong, we love growth ๐ฑint uv_thread_detach(uv_thread_t *tid)โ detaches a thread. Detached threads automatically release their resources upon termination, eliminating the need for the application to calluv_thread_join. Set it free, it'll clean up after itself ๐ฆ Added in version 1.26.0... wait, no โ Added in version 1.50.0. โจint uv_thread_create_ex(uv_thread_t *tid, const uv_thread_options_t *params, uv_thread_cb entry, void *arg)โ likeuv_thread_create(), but with bonus options for creating a new thread ๐
If UV_THREAD_HAS_STACK_SIZE is set, then stack_size specifies a stack size for the new thread. A 0 means "use the default value", i.e. it behaves exactly as if the flag was not set. Any other value gets rounded up to the nearest page boundary โ math is math ๐
Added in version 1.26.0.
int uv_thread_setaffinity(uv_thread_t *tid, char *cpumask, char *oldmask, size_t mask_size)โ sets the specified thread's affinity tocpumask, which is specified in bytes. Optionally it also returns the previous affinity setting inoldmaskโ a little before-and-after pic ๐ธ
On Unix, it uses pthread_getaffinity_np(3) to get the affinity setting and maps the cpu_set_t to bytes in oldmask. Then it maps the bytes in cpumask to a cpu_set_t and uses pthread_setaffinity_np(3). On Windows, it maps the bytes in cpumask to a bitmask and uses SetThreadAffinityMask(), which returns the previous affinity setting.
mask_size specifies the number of entries (bytes) in cpumask / oldmask, and must be greater-than-or-equal-to uv_cpumask_size() ๐
Note: thread affinity setting is not atomic on Windows. Unsupported on macOS. So like, plan accordingly bestie ๐ญ
Added in version 1.45.0.
int uv_thread_getaffinity(uv_thread_t *tid, char *cpumask, size_t mask_size)โ gets the specified thread's affinity setting. On Unix, this maps thecpu_set_treturned bypthread_getaffinity_np(3)to bytes incpumask.
mask_size specifies the number of entries (bytes) in cpumask, and must be greater-than-or-equal-to uv_cpumask_size() ๐ธ
Note: thread affinity getting is not atomic on Windows. Unsupported on macOS. Again. Same energy ๐
Added in version 1.45.0.
int uv_thread_getcpu(void)โ gets the CPU number on which the calling thread is running. Where am I? On which core? The mystery is solved ๐
Note: currently only implemented on Windows, Linux and FreeBSD. Everywhere else it's just vibes ๐ซ
Added in version 1.45.0.
uv_thread_t uv_thread_self(void)โ gives you the current thread. Your own little self ๐ชint uv_thread_join(uv_thread_t *tid)โ waits for that thread to finish up. The "I'm not leaving without you" of functions ๐ซถint uv_thread_equal(const uv_thread_t *t1, const uv_thread_t *t2)โ checks whethert1andt2are the same thread. Twin check ๐int uv_thread_setname(const char *name)โ sets the name of the current thread. Every platform has its own limit on how many characters a thread name can be: Linux, IBM i (16), macOS (64), Windows (32767), and NetBSD (32), etc.uv_thread_setname()will truncate it in casenameis larger than the platform's limit โ sorry, your essay is getting cut โ๏ธ
Not supported on Windows Server 2016, returns UV_ENOSYS. Rude, but okay.
Added in version 1.50.0.
int uv_thread_getname(uv_thread_t *tid, char *name, size_t *size)โ gets the name of the thread specified bytid. The thread name is copied, with the trailing NUL, into the buffer pointed to byname. Thesizeparameter specifies the size of the buffer pointed to byname. The buffer should be large enough to hold the name of the thread plus the trailing NUL, or it will be truncated to fit with the trailing NUL. So like, size your buffer properly or lose letters ๐ฌ
It's undefined behavior to call this after the thread has terminated. Do not do that. Seriously, don't. โ ๏ธ
Not supported on Windows Server 2016, returns UV_ENOSYS.
Added in version 1.50.0.
int uv_thread_setpriority(uv_thread_t tid, int priority)โ if the function succeeds, the return value is0. If the function fails, the return value is less than zero. Sets the scheduling priority of the thread specified bytid. Some platforms require elevated privilege to set specific priorities โ so like, you might need admin energy for this one ๐
The priority can be set to the following constants: UV_THREAD_PRIORITY_HIGHEST, UV_THREAD_PRIORITY_ABOVE_NORMAL, UV_THREAD_PRIORITY_NORMAL, UV_THREAD_PRIORITY_BELOW_NORMAL, UV_THREAD_PRIORITY_LOWEST.
It's undefined behavior to call this after the thread has terminated. Same warning, same drama ๐ซ
Added in version 1.48.0.
int uv_thread_getpriority(uv_thread_t tid, int *priority)โ returns0if it worked, and something less than zero if it flopped ๐ญ. It grabs the scheduling priority of the thread you point at withtid, and the value that lands in the output parampriorityis platform dependent. On Linux, when the scheduling policy isSCHED_OTHER(the default),prioritycomes back as0.
โ ๏ธ Calling this after the thread has already terminated is undefined behavior. Do not do that, bestie. That's a vibe check you will fail ๐.
Added in version 1.48.0 โจ.
๐งต Thread-local storage
๐ Note: the total thread-local storage size may be limited. Like, it may literally not be possible to create a whole bunch of TLS keys. Budget accordingly ๐.
int uv_key_create(uv_key_t *key)โ makes you a shiny new TLS key โจvoid uv_key_delete(uv_key_t *key)โ yeets the key into the voidvoid *uv_key_get(uv_key_t *key)โ reads the value hanging off that keyvoid uv_key_set(uv_key_t *key, void *value)โ sets the value on that key
๐ฏ Once-only initialization
Runs a function once and only once. Like, periodt ๐
. When concurrent calls to uv_once() all show up with the same guard, every caller gets blocked except one โ and it's unspecified which one gets the honor, so no favorites ๐. The guard should be initialized statically with the UV_ONCE_INIT macro.
void uv_once(uv_once_t *guard, void (*callback)(void))โ the one-shot wonder
๐ Mutex locks
All of these return 0 on success or an error code < 0 โ unless the return type is void, of course, because then there's literally nothing to return ๐.
int uv_mutex_init(uv_mutex_t *handle)โ spins up your mutexint uv_mutex_init_recursive(uv_mutex_t *handle)โ same but recursive, so the same thread can lock it again, no dramavoid uv_mutex_destroy(uv_mutex_t *handle)โ destroys it, free the memory, move onvoid uv_mutex_lock(uv_mutex_t *handle)โ locks it (may block, that's the whole point)int uv_mutex_trylock(uv_mutex_t *handle)โ tries to lock and does not block if it can't, so you get an answer immediatelyvoid uv_mutex_unlock(uv_mutex_t *handle)โ unlocks it, release the vibes
๐ Read-write locks
Same deal: functions return 0 on success or an error code < 0 (unless the return type is void, obviously ๐).
int uv_rwlock_init(uv_rwlock_t *rwlock)โ initialize the rwlockvoid uv_rwlock_destroy(uv_rwlock_t *rwlock)โ destroy itvoid uv_rwlock_rdlock(uv_rwlock_t *rwlock)โ grab a read lockint uv_rwlock_tryrdlock(uv_rwlock_t *rwlock)โ try for a read lock without committingvoid uv_rwlock_rdunlock(uv_rwlock_t *rwlock)โ drop the read lockvoid uv_rwlock_wrlock(uv_rwlock_t *rwlock)โ grab a write lockint uv_rwlock_trywrlock(uv_rwlock_t *rwlock)โ try for a write lock, no blockingvoid uv_rwlock_wrunlock(uv_rwlock_t *rwlock)โ drop the write lock
๐ฆ Semaphores
Again, friends: return 0 on success or an error code < 0 (unless it's void, you know the drill ๐).
int uv_sem_init(uv_sem_t *sem, unsigned int value)โ init the semaphore with an initialvaluevoid uv_sem_destroy(uv_sem_t *sem)โ destroy itvoid uv_sem_post(uv_sem_t *sem)โ post to it, bump it upvoid uv_sem_wait(uv_sem_t *sem)โ wait on itint uv_sem_trywait(uv_sem_t *sem)โ try to wait, but don't block if you can't
๐ธ Conditions
Yeah yeah โ 0 on success, error code < 0 on failure, unless the return type is void, as ever ๐.
๐ Note: 1. Callers should be prepared to deal with spurious wakeups onuv_cond_wait()anduv_cond_timedwait(). Like, it can just wake up for no reason. Handle it. Don't be weird about it ๐. 2. Thetimeoutparameter foruv_cond_timedwait()is relative to the time at which the function is called. Not absolute. Relative. โจ 3. On z/OS, thetimeoutparameter foruv_cond_timedwait()gets converted into an absolute system time at which the wait expires ๐ฐ๏ธ. If the current system clock time passes that calculated absolute time before the condition is signaled, you get anETIMEDOUTerror. Once the wait begins, the wait time is not affected by changes to the system clock. Iconic platform-specific behavior ngl.
int uv_cond_init(uv_cond_t *cond)โ init the conditionvoid uv_cond_destroy(uv_cond_t *cond)โ destroy itvoid uv_cond_signal(uv_cond_t *cond)โ signal one waitervoid uv_cond_broadcast(uv_cond_t *cond)โ broadcast to literally everyonevoid uv_cond_wait(uv_cond_t *cond, uv_mutex_t *mutex)โ wait on the condition with the given mutexint uv_cond_timedwait(uv_cond_t *cond, uv_mutex_t *mutex, uint64_t timeout)โ wait, but with atimeoutso you don't wait forever
๐งฑ Barriers
You already know: 0 on success, error code < 0 otherwise, unless the type is void ๐.
๐ Note:uv_barrier_wait()returns a value> 0to an arbitrarily chosen "serializer" thread to facilitate cleanup, i.e.c if (uv_barrier_wait(&barrier) > 0) uv_barrier_destroy(&barrier);One thread gets picked to do the cleanup chores. Main character energy ๐.
int uv_barrier_init(uv_barrier_t *barrier, unsigned int count)โ init the barrier with acountof threadsvoid uv_barrier_destroy(uv_barrier_t *barrier)โ destroy the barrierint uv_barrier_wait(uv_barrier_t *barrier)โ wait at the barrier
๐งฐ Miscellaneous utilities
This is the catch-all section โ the miscellaneous functions that don't really belong in any other section. The island of misfit toys ๐ง.
๐ฎ Data types
uv_buf_t
Buffer data type. The blueprint of a buffer ๐.
char *uv_buf_t.baseโ pointer to the base of the buffersize_t uv_buf_t.lenโ total bytes in the buffer
๐ Note: on Windows this field is ULONG.
typedef void *(*uv_malloc_func)(size_t size)
Replacement function for malloc(3). See uv_replace_allocator() ๐ซถ.
typedef void *(*uv_realloc_func)(void *ptr, size_t size)
Replacement function for realloc(3). See uv_replace_allocator().
typedef void *(*uv_calloc_func)(size_t count, size_t size)
Replacement function for calloc(3). See uv_replace_allocator().
typedef void (*uv_free_func)(void *ptr)
Replacement function for free(3). See uv_replace_allocator().
typedef void (*uv_random_cb)(uv_random_t *req, int status, void *buf, size_t buflen)
The callback you pass to uv_random(). status is non-zero in case of error ๐ญ. The buf pointer is the same pointer that was passed to uv_random() โ no sneaky swaps, fr fr.
uv_file
Cross platform representation of a file handle ๐๏ธ.
uv_os_sock_t
Cross platform representation of a socket handle ๐.
uv_os_fd_t
Abstract representation of a file descriptor. On Unix systems this is a typedef of int and on Windows a HANDLE.
uv_pid_t
Cross platform representation of a pid_t ๐.
Added in version 1.16.0.
uv_timeval_t
Y2K38-unsafe data type for storing times with microsecond resolution โณ. Will be replaced with uv_timeval64_t in libuv v2.0.
typedef struct {
long tv_sec;
long tv_usec;
} uv_timeval_t;
uv_timeval64_t
Y2K38-safe data type for storing times with microsecond resolution ๐ก๏ธ.
typedef struct {
int64_t tv_sec;
int32_t tv_usec;
} uv_timeval64_t;
uv_timespec64_t
Y2K38-safe data type for storing times with nanosecond resolution โจ.
typedef struct {
int64_t tv_sec;
int32_t tv_nsec;
} uv_timespec64_t;
enum uv_clock_id
Clock source for uv_clock_gettime() ๐ฐ๏ธ.
typedef enum {
UV_CLOCK_MONOTONIC,
UV_CLOCK_REALTIME
} uv_clock_id;
uv_rusage_t
Data type for resource usage results ๐.
typedef struct {
uv_timeval_t ru_utime; /* user CPU time used */
uv_timeval_t ru_stime; /* system CPU time used */
uint64_t ru_maxrss; /* maximum resident set size */
uint64_t ru_ixrss; /* integral shared memory size (X) */
uint64_t ru_idrss; /* integral unshared data size (X) */
uint64_t ru_isrss; /* integral unshared stack size (X) */
uint64_t ru_minflt; /* page reclaims (soft page faults) (X) */
uint64_t ru_majflt; /* page faults (hard page faults) */
uint64_t ru_nswap; /* swaps (X) */
uint64_t ru_inblock; /* block input operations */
uint64_t ru_oublock; /* block output operations */
uint64_t ru_msgsnd; /* IPC messages sent (X) */
uint64_t ru_msgrcv; /* IPC messages received (X) */
uint64_t ru_nsignals; /* signals received (X) */
uint64_t ru_nvcsw; /* voluntary context switches (X) */
uint64_t ru_nivcsw; /* involuntary context switches (X) */
} uv_rusage_t;
Members marked with (X) are unsupported on Windows ๐
. See getrusage(2) for supported fields on UNIX-like platforms.
The maximum resident set size is reported in kilobytes โ the unit most platforms use natively, so slay, no conversion needed ๐ .
uv_cpu_info_t
Data type for CPU information ๐ฅ.
typedef struct uv_cpu_info_s {
char* model;
int speed;
struct uv_cpu_times_s {
uint64_t user; /* milliseconds */
uint64_t nice; /* milliseconds */
uint64_t sys; /* milliseconds */
uint64_t idle; /* milliseconds */
uint64_t irq; /* milliseconds */
} cpu_times;
} uv_cpu_info_t;
uv_interface_address_t
Data type for interface addresses ๐.
typedef struct uv_interface_address_s {
char* name;
char phys_addr[6];
int is_internal;
union {
struct sockaddr_in address4;
struct sockaddr_in6 address6;
} address;
union {
struct sockaddr_in netmask4;
struct sockaddr_in6 netmask6;
} netmask;
} uv_interface_address_t;
uv_passwd_t
Data type for password file information ๐.
typedef struct uv_passwd_s {
char* username;
long uid;
long gid;
char* shell;
char* homedir;
} uv_passwd_t;
uv_group_t
Data type for group file information ๐ฏ.
typedef struct uv_group_s {
char* groupname;
unsigned long gid;
char** members;
} uv_group_t;
uv_utsname_t
Data type for operating system name and version information ๐ฅ๏ธ.
typedef struct uv_utsname_s {
char sysname[256];
char release[256];
char version[256];
char machine[256];
} uv_utsname_t;
uv_env_item_t
Data type for environment variable storage ๐ฑ.
typedef struct uv_env_item_s {
char* name;
char* value;
} uv_env_item_t;
โฆaaand uv_random_t, which is literally just a random data request type. that's it. that's the whole vibe. ๐ฒ
โจ API โจ
okay bestie, here comes the fun part โ this is the actual toolbox. every function gets its exact signature, so no guessing ๐
uv_handle_type uv_guess_handle(uv_file file)
Detects what kind of stream you should be using with a given file descriptor. normally you'd call this at init time to figure out what the stdio streams actually are โ like, is this thing a TTY or a pipe, iykyk? ๐
For isatty(3)-equivalent functionality, use this function and then test for UV_TTY.
int uv_replace_allocator(uv_malloc_func malloc_func, uv_realloc_func realloc_func, uv_calloc_func calloc_func, uv_free_func free_func)
Added in version 1.6.0.
This one lets you override the standard library's malloc(3), calloc(3), realloc(3) and free(3) memory allocation functions. absolute control, no cap. ๐
You must call this before any other libuv function is called โ or, alternately, after all resources have been freed so libuv isn't referencing any allocated memory chunk. timing is everything, fr.
On success it returns 0. if any of the function pointers is NULL, it returns UV_EINVAL.
โ ๏ธ Warning: there's no protection against changing the allocator multiple times. if the user changes it, they're responsible for making sure the allocator is changed while no memory was allocated with the previous allocator โ or that the two allocators are compatible. so likeโฆ be careful.
โ ๏ธ Warning: the allocator must be thread-safe. non-negotiable.
void uv_library_shutdown(void);
Added in version 1.38.0.
Releases any global state that libuv is holding onto. libuv normally does this automatically when it's unloaded, but you can tell it to do the cleanup manually if you want to be extra. ๐งน
โ ๏ธ Warning: only call uv_library_shutdown() once.
โ ๏ธ Warning: don't call uv_library_shutdown() when there are still event loops or I/O requests active.
โ ๏ธ Warning: don't call libuv functions after calling uv_library_shutdown(). like, at all. that's the end of the era.
uv_buf_t uv_buf_init(char *base, unsigned int len)
Constructor for uv_buf_t. ๐ผ
Because platforms are messy, the user can't rely on the ordering of the base and len members of the uv_buf_t struct. the user is responsible for freeing base after the uv_buf_t is done with. returns the struct passed by value.
โ ๏ธ Warning: it's discouraged to setlento a large value, because that may result in spurious failures. specifically: Windows may fail on writes larger than about 511 MB, and various Unicies may fail on I/O larger than about 2 GB (0x7ffff000bytes). instead it's generally better to split the data into multipleuv_writecalls โ attach thewrite_cbto the last one. ๐งฉ
char **uv_setup_args(int argc, char **argv)
Stores the program arguments. this is required for getting/setting the process title, or the executable path. libuv may take ownership of the memory that argv points to. โ ๏ธ call this function exactly once, at program start-up. no seconds, no thirds.
Example:
argv = uv_setup_args(argc, argv); /* May return a copy of argv. */
int uv_get_process_title(char *buffer, size_t size)
Gets the title of the current process. on Unix and AIX systems you must call uv_setup_args before calling this. if uv_setup_args hasn't been called on systems that require it, then UV_ENOBUFS is returned. if buffer is NULL or size is zero, UV_EINVAL is returned. if size can't accommodate the process title plus the terminating nul character, the function returns UV_ENOBUFS. ๐
๐ Note: on BSD systems,uv_setup_argsis needed for getting the initial process title. the process title returned will be an empty string until eitheruv_setup_argsoruv_set_process_titleis called.
Changed in version 1.18.1: now thread-safe on all supported platforms.
Changed in version 1.39.0: now returns an error if uv_setup_args is needed but hasn't been called.
int uv_set_process_title(const char *title)
Sets the current process title. on Unix and AIX systems you must call uv_setup_args before calling this. if uv_setup_args hasn't been called on systems that require it, then UV_ENOBUFS is returned. on platforms with a fixed size buffer for the process title, the contents of title will be copied into the buffer and truncated if it's larger than the available space. other platforms will return UV_ENOMEM if they can't allocate enough space to duplicate the contents of title. โ๏ธ
Changed in version 1.18.1: now thread-safe on all supported platforms.
Changed in version 1.39.0: now returns an error if uv_setup_args is needed but hasn't been called.
int uv_resident_set_memory(size_t *rss)
Gets the resident set size (RSS) for the current process. memory check, bestie. ๐ง
int uv_uptime(double *uptime)
Gets the current system uptime. depending on the system, you get full or fractional seconds back. โฐ
int uv_getrusage(uv_rusage_t *rusage)
Gets the resource usage measures for the current process. ๐
๐ Note: on Windows not all fields are set โ the unsupported fields are filled with zeroes. see uv_rusage_t for more details.
int uv_getrusage_thread(uv_rusage_t *rusage)
Gets the resource usage measures for the calling thread. ๐งต
Added in version 1.50.0.
๐ Note: not supported on all platforms. may returnUV_ENOTSUP. on macOS and Windows not all fields are set โ the unsupported fields are filled with zeroes. seeuv_rusage_tfor more details.
uv_pid_t uv_os_getpid(void)
Returns the current process ID. ๐ชช
Added in version 1.18.0.
uv_pid_t uv_os_getppid(void)
Returns the parent process ID. hi mom ๐
Added in version 1.16.0.
unsigned int uv_available_parallelism(void)
Returns an estimate of the default amount of parallelism a program should use. always returns a non-zero value. ๐ช
On Linux, it inspects the calling thread's CPU affinity mask to determine whether it's been pinned to specific CPUs.
On Windows, the available parallelism may be underreported on systems with more than 64 logical CPUs.
On other platforms, it reports the number of CPUs that the operating system considers to be online.
Added in version 1.44.0.
int uv_cpu_info(uv_cpu_info_t **cpu_infos, int *count)
Gets information about the CPUs on the system. the cpu_infos array will have count elements and needs to be freed with uv_free_cpu_info(). ๐ฅ๏ธโจ
Use uv_available_parallelism() if you actually need to know how many CPUs are available for threads or child processes.
void uv_free_cpu_info(uv_cpu_info_t *cpu_infos, int count)
Frees the cpu_infos array previously allocated with uv_cpu_info(). bye bye memory ๐ซถ
int uv_cpumask_size(void)
Returns the maximum size of the mask used for process/thread affinities โ or UV_ENOTSUP if affinities aren't supported on the current platform. ๐ญ
Added in version 1.45.0.
int uv_interface_addresses(uv_interface_address_t **addresses, int *count)
Gets address information about the network interfaces on the system. an array of count elements is allocated and returned in addresses. the user must free it by calling uv_free_interface_addresses(). ๐
void uv_free_interface_addresses(uv_interface_address_t *addresses, int count)
Frees an array of uv_interface_address_t which was returned by uv_interface_addresses(). ๐๏ธ
void uv_loadavg(double avg[3])
Gets the load average. see: https://en.wikipedia.org/wiki/Load_(computing) ๐
๐ Note: returns [0,0,0] on Windows (i.e., it's not implemented). we don't talk about that.
int uv_ip4_addr(const char *ip, int port, struct sockaddr_in *addr)
Converts a string containing an IPv4 address into a binary structure. ๐ข
int uv_ip6_addr(const char *ip, int port, struct sockaddr_in6 *addr)
Converts a string containing an IPv6 address into a binary structure. ๐ข
int uv_ip4_name(const struct sockaddr_in *src, char *dst, size_t size)
Converts a binary structure containing an IPv4 address into a string. ๐ค
int uv_ip6_name(const struct sockaddr_in6 *src, char *dst, size_t size)
Converts a binary structure containing an IPv6 address into a string. ๐ค
int uv_ip_name(const struct sockaddr *src, char *dst, size_t size)
Converts a binary structure containing an IPv4 address or an IPv6 address into a string. either one, she's flexible like that. ๐
int uv_inet_ntop(int af, const void *src, char *dst, size_t size)
int uv_inet_pton(int af, const char *src, void *dst)
Cross-platform, IPv6-capable implementation of inet_ntop(3) and inet_pton(3). on success they return 0. in case of error, the target dst pointer is left unmodified. ๐ฐ๏ธ
UV_IF_NAMESIZE
Maximum IPv6 interface identifier name length. defined as IFNAMSIZ on Unix and IF_NAMESIZE on Linux and Windows. ๐
Added in version 1.16.0.
int uv_if_indextoname(unsigned int ifindex, char *buffer, size_t *size)
Okay so this one is basically if_indextoname(3) but make it IPv6-coded โจ. You call it, and *size on the way in tells it how long your buffer is (that's where the result goes).
On success you get a big fat 0 back, buffer is holding the interface name, and *size becomes the string length of the buffer โ and note that it does not count the NUL terminator byte in *size. Like, it's excluded, bestie, don't @ me. On error you get a negative value back. And if buffer is too smol to hold the result, you get UV_ENOBUFS and *size tells you the necessary size in bytes, and this time it does include the NUL terminator byte in *size. Growth mindset ๐
.
On Unix the returned interface name can be used directly as an interface identifier in scoped IPv6 addresses, like fe80::abc:def1:2345%en0. Iconic.
On Windows tho? Nope โ the returned interface cannot be used as an interface identifier, because Windows uses numerical interface identifiers, like fe80::abc:def1:2345%5. Different vibes entirely.
So if you want an interface identifier in a cross-platform compatible way, use uv_if_indextoiid(). That's the move ๐ซถ.
Example:
char ifname[UV_IF_NAMESIZE];
size_t size = sizeof(ifname);
uv_if_indextoname(sin6->sin6_scope_id, ifname, &size);
Added in version 1.16.0. ๐
int uv_if_indextoiid(unsigned int ifindex, char *buffer, size_t *size)
This one grabs you a network interface identifier that's suitable for use in an IPv6 scoped address. On Windows it just returns the numeric ifindex as a string. On literally every other platform it calls uv_if_indextoname() for you. So thoughtful of it ๐.
The result gets written to buffer, with *size indicating the length of buffer. If buffer isn't big enough to hold the result, then UV_ENOBUFS is returned, and *size represents the size โ including the NUL byte โ required to hold the result.
See uv_if_indextoname for further details. Go read it, iykyk.
Added in version 1.16.0. ๐ฆ
int uv_exepath(char *buffer, size_t *size)
Gets the executable path. Lowkey crucial detail: you must call uv_setup_args before calling this function. Like, that's a prerequisite, not a suggestion.
Be careful in setuid executables ๐ญ. On some platforms the executable path is an arbitrary string that is controlled by the user. On other platforms environment variables are consulted that may be under control of the user. So yeah โ trust issues, fr fr.
int uv_cwd(char *buffer, size_t *size)
Gets the current working directory and stores it in buffer. If the current working directory is too large to fit in buffer, this function returns UV_ENOBUFS and sets size to the required length, including the null terminator. No silent truncation, she's honest ๐
.
Changed in version 1.1.0: on Unix the path no longer ends in a slash. Clean girl aesthetic.
Changed in version 1.9.0: the returned length includes the terminating null byte on UV_ENOBUFS, and the buffer is null terminated on success. Both glow-ups at once, we love to see it โจ.
int uv_chdir(const char *dir)
Changes the current working directory. That's it, that's the whole thing. Short and slay ๐ง.
int uv_os_homedir(char *buffer, size_t *size)
Gets the current user's home directory ๐ . On Windows, uv_os_homedir() first checks the USERPROFILE environment variable using GetEnvironmentVariableW(). If USERPROFILE isn't set, GetUserProfileDirectoryW() is called. On all other operating systems, uv_os_homedir() first checks the HOME environment variable using getenv(3). If HOME isn't set, getpwuid_r(3) is called.
The user's home directory is stored in buffer. When uv_os_homedir() is called, size indicates the maximum size of buffer. On success size is set to the string length of buffer. On UV_ENOBUFS failure size is set to the required length for buffer, including the null byte.
Warning: uv_os_homedir() is not thread safe ๐. Don't be brave.
Added in version 1.6.0. ๐ธ
int uv_os_tmpdir(char *buffer, size_t *size)
Gets the temp directory ๐ก๏ธ. On Windows, uv_os_tmpdir() uses GetTempPathW(). On all other operating systems, uv_os_tmpdir() uses the first environment variable found in this ordered list: TMPDIR, TMP, TEMP, and TEMPDIR. Order matters, bestie, it's a priority queue of vibes. If none of these are found, the path /tmp is used, or, on Android, /data/local/tmp is used.
The temp directory is stored in buffer. When uv_os_tmpdir() is called, size indicates the maximum size of buffer. On success size is set to the string length of buffer (which does not include the terminating null). On UV_ENOBUFS failure size is set to the required length for buffer, including the null byte.
Warning: uv_os_tmpdir() is not thread safe ๐. Same energy as above, same rule.
Added in version 1.9.0. โญ
int uv_os_get_passwd(uv_passwd_t *pwd)
Gets a subset of the password file entry for the current effective uid โ not the real uid, okay, effective, keep up โจ. The populated data includes the username, euid, gid, shell, and home directory. On non-Windows systems, all data comes from getpwuid_r(3). On Windows, uid and gid are set to -1 and have no meaning, and shell is NULL.
After successfully calling this function, the memory allocated to pwd needs to be freed with uv_os_free_passwd(). Clean up after yourself, main character energy includes taking out the trash ๐๏ธ๐.
Added in version 1.9.0. ๐
int uv_os_get_passwd2(uv_passwd_t *pwd, uv_uid_t uid)
Same deal as above but for the uid you provide, instead of the current effective one. The populated data includes the username, euid, gid, shell, and home directory. On non-Windows systems, all data comes from getpwuid_r(3). On Windows, uid and gid are set to -1 and have no meaning, and shell is NULL.
After successfully calling this function, the memory allocated to pwd needs to be freed with uv_os_free_passwd(). Yes, again. Free your memory, babes ๐ซถ.
Added in version 1.45.0. ๐ฆ
int uv_os_get_group(uv_group_t *group, uv_uid_t gid)
Gets a subset of the group file entry for the provided uid. The populated data includes the group name, gid, and members. On non-Windows systems, all data comes from getgrgid_r(3). On Windows, uid and gid are set to -1 and have no meaning.
After successfully calling this function, the memory allocated to group needs to be freed with uv_os_free_group(). You know the drill ๐
.
Added in version 1.45.0. ๐
void uv_os_free_group(uv_passwd_t *pwd)
Frees the memory previously allocated with uv_os_get_group(). That's the whole assignment. Do it. ๐
Added in version 1.45.0. ๐
void uv_os_free_passwd(uv_passwd_t *pwd)
Frees the pwd memory previously allocated with uv_os_get_passwd(). Yes, the param is literally called pwd, we're keeping it exactly as written, no notes โจ.
Added in version 1.9.0. ๐ง
uint64_t uv_get_free_memory(void)
Gets the amount of free memory available in the system, as reported by the kernel (in bytes). Returns 0 when unknown. When she doesn't know, she says she doesn't know โ healthy communication ๐.
uint64_t uv_get_total_memory(void)
Gets the total amount of physical memory in the system (in bytes). Returns 0 when unknown. Same energy, no cap ๐ฅ.
uint64_t uv_get_constrained_memory(void)
Gets the total amount of memory available to the process (in bytes) based on limits imposed by the OS. If there's no such constraint, or the constraint is unknown, 0 is returned. But if there is a constraining mechanism and yet no constraint is set, UINT64_MAX is returned. Sneaky little distinction, right? ๐
Note that it is not unusual for this value to be less than or greater than uv_get_total_memory(). Yeah. Greater. Don't ask, it's just built different.
Note: This function currently only returns a non-zero value on Linux, based on cgroups if it is present, and on z/OS based on RLIMIT_MEMLIMIT. Soz, everywhere else โ๏ธ.
Added in version 1.29.0. ๐
uint64_t uv_get_available_memory(void)
Gets the amount of free memory that is still available to the process (in bytes). This differs from uv_get_free_memory() in that it takes into account any limits imposed by the OS. If there's no such constraint, or the constraint is unknown, the amount returned will be identical to uv_get_free_memory(). Twins when there are no limits ๐ซถโจ.
Note: This function currently only returns a value that is different from what uv_get_free_memory() reports on Linux, based on cgroups if it is present. Linux stays having the most lore, honestly.
Added in version 1.45.0. ๐
uint64_t uv_hrtime(void)
Returns the current high-resolution timestamp. This is expressed in nanoseconds โฑ๏ธ. It's relative to an arbitrary time in the past โ like, she's not telling you when the clock started, that's personal. It is not related to the time of day and therefore not subject to clock drift. The primary use is for measuring performance between intervals. Benchmark bestie behaviour, periodt.
Note: Not every platform can support nanosecond resolution; however, this value will always be in nanoseconds. The unit is consistent even when the precision can't be ๐ .
int uv_clock_gettime(uv_clock_id clock_id, uv_timespec64_t *ts)
Obtains the current system time from a high-resolution real-time or monotonic clock source. Two clocks, two vibes, choose wisely ๐ฎ.
The real-time clock counts from the UNIX epoch (1970-01-01) and is subject to time adjustments; it can jump back in time. ๐ญ Betrayal.
The monotonic clock counts from an arbitrary point in the past and never jumps back in time. Loyal. Reliable. The one you want.
Added in version 1.45.0. ๐ธ
void uv_print_all_handles(uv_loop_t *loop, FILE *stream)
Prints all handles associated with the given loop to the given stream. Full tea, spilled ๐ซ.
Example:
uv_print_all_handles(uv_default_loop(), stderr);
/*
[--I] signal 0x1a25ea8
[-AI] async 0x1a25cf0
[R--] idle 0x1a7a8c8
*/
The format is [flags] handle-type handle-address. And for the flags:
Ris printed for a handle that is referencedAis printed for a handle that is activeIis printed for a handle that is internal
Warning: This function is meant for ad hoc debugging, there is no API/ABI stability guarantees ๐ฌ. Cute for a quick look, not for building your whole app on top of, bestie.
Added in version 1.8.0. ๐
void uv_print_active_handles(uv_loop_t *loop, FILE *stream)
This is the same as uv_print_all_handles() except only active handles are printed. Filtered. Curated. Minimalist ๐โจ.
Warning: This function is meant for ad hoc debugging, there is no API/ABI stability guarantees. Same warning, same seriousness, don't come crying to me ๐ฅ.
Added in version 1.8.0. ๐ฆ
int uv_os_environ(uv_env_item_t **envitems, int *count)
okay so this one grabs, like, every single environment variable on the system and hands them all to you in envitems, with the count dropped into count. but bestie listen โ it allocates memory for you, and you have to free it yourself with uv_os_free_environ(). don't just walk away from it, that's not the vibe ๐
โ ๏ธ Warning: this function is not thread safe. no cap, don't be calling it from five threads at once thinking it'll slay.
Added in version 1.31.0.
void uv_os_free_environ(uv_env_item_t *envitems, int count);
the designated cleanup crew ๐งน โ frees the memory that uv_os_environ() allocated. pass it the same envitems and count and you're gucci.
Added in version 1.31.0.
int uv_os_getenv(const char *name, char *buffer, size_t *size)
grabs the env variable called name, copies its value into buffer, and sets size to the string length of that value. the way that you have to do the math yourself first tho ๐ญ โ when you call it, size must already be set to the amount of storage available in buffer, including the null terminator.
if the variable is bigger than your buffer, you get UV_ENOBUFS back and size gets set to the amount of storage you'd actually need. so like, it tells you how much room to give it. iconic of it tbh. and if there's no matching environment variable at all? you get UV_ENOENT. โจ
โ ๏ธ Warning: not thread safe. fr fr.
Added in version 1.12.0.
int uv_os_setenv(const char *name, const char *value)
creates the environment variable name with value โ or updates it if it already exists. either way it's getting set, no questions asked ๐ซถ
โ ๏ธ Warning: not thread safe.
Added in version 1.12.0.
int uv_os_unsetenv(const char *name)
deletes the environment variable called name. and here's the cute part โ if that variable doesn't even exist, this still returns successfully. it's not gonna be dramatic about it. it's at peace ๐
โ ๏ธ Warning: not thread safe.
Added in version 1.12.0.
int uv_os_gethostname(char *buffer, size_t *size)
gives you the hostname as a null-terminated string in buffer, and sets size to the string length of the hostname. same deal as before: size must be set to the storage available in buffer, including the null terminator. too small? UV_ENOBUFS, and size tells you how much you actually need.
Added in version 1.12.0.
Changed in version 1.26.0: UV_MAXHOSTNAMESIZE is available now and it represents the maximum buffer size you need to store a hostname plus that terminating nul character. so you don't gotta guess anymore ๐
int uv_os_getpriority(uv_pid_t pid, int *priority)
fetches the scheduling priority of the process identified by pid. the priority you get back lands between -20 (high priority) and 19 (low priority). think of it like niceness but the numbers are doing their own thing ๐
๐ Note: on Windows, the returned priority will equal one of the UV_PRIORITY constants.
Added in version 1.23.0.
int uv_os_setpriority(uv_pid_t pid, int priority)
sets the scheduling priority of the process specified by pid. priority goes between -20 (high priority) and 19 (low priority). and for convenience they hand you these constants so you don't have to memorize the numbers:
UV_PRIORITY_LOWUV_PRIORITY_BELOW_NORMALUV_PRIORITY_NORMALUV_PRIORITY_ABOVE_NORMALUV_PRIORITY_HIGHUV_PRIORITY_HIGHEST
๐ Note: on Windows this function utilizesSetPriorityClass(). thepriorityargument gets mapped to a Windows priority class. and when you retrieve the process priority afterward, the result will equal one of theUV_PRIORITYconstants โ not necessarily the exact value ofpriorityyou passed in. so don't come for it when the number looks different ๐
๐ Note: on Windows, settingPRIORITY_HIGHESTwill only work for an elevated user. for everyone else it gets silently reduced toPRIORITY_HIGH. sneaky little downgrade.
๐ Note: on IBM i PASE, the highest process priority is-10. the constants shake out like this:UV_PRIORITY_HIGHESTis-10,UV_PRIORITY_HIGHis-7,UV_PRIORITY_ABOVE_NORMALis-4,UV_PRIORITY_NORMALis0,UV_PRIORITY_BELOW_NORMALis15andUV_PRIORITY_LOWis39.
๐ Note: on IBM i PASE you're not allowed to change your priority unless you have the *JOBCTL special authority โ and yes, that includes lowering it. like, even being nice needs permission. rude.
Added in version 1.23.0.
int uv_os_uname(uv_utsname_t *buffer)
pulls system information into buffer. the populated data includes the operating system name, release, version, and machine. on non-Windows systems, uv_os_uname() is a thin wrapper around uname(2). returns zero on success and a non-zero error value otherwise. โจ
Added in version 1.25.0.
int uv_gettimeofday(uv_timeval64_t *tv)
the cross-platform implementation of gettimeofday(2). heads up though โ the timezone argument to gettimeofday() is not supported, because it's considered obsolete. it's giving legacy code that everyone agreed to stop talking about ๐
Added in version 1.28.0.
int uv_random(uv_loop_t *loop, uv_random_t *req, void *buf, size_t buflen, unsigned int flags, uv_random_cb cb)
fills buf with exactly buflen cryptographically strong random bytes acquired from the system CSPRNG. and flags โ that's reserved for future extension and must currently be 0. no funny business ๐ฅ
short reads are not possible. when less than buflen random bytes are available, you get a non-zero error value returned or passed to the callback. that's it, that's the deal.
okay and here's where it gets real: the synchronous version may block indefinitely when not enough entropy is available. the asynchronous version may not ever finish when the system is low on entropy. so like... it could just vibe there forever. ๐
Sources of entropy (where the randomness comes from, per platform):
- Windows:
RtlGenRandom - Linux, Android:
getrandom(2)if available, orurandom(4)after reading from/dev/randomonce, or theKERN_RANDOMsysctl(2) - FreeBSD:
getrandom(2), or/dev/urandomafter reading from/dev/randomonce - NetBSD:
KERN_ARNDsysctl(7) - macOS, OpenBSD:
getentropy(2)if available, or/dev/urandomafter reading from/dev/randomonce - AIX:
/dev/random - IBM i:
/dev/urandom - Other UNIX:
/dev/urandomafter reading from/dev/randomonce
Returns
0 on success, or an error code < 0 on failure. the contents of buf is undefined after an error โ so don't go reading it and acting surprised ๐
๐ Note: when using the synchronous version, bothloopandreqparameters are not used and can be set toNULL.
Added in version 1.33.0.
void uv_sleep(unsigned int msec)
puts the calling thread to sleep for msec milliseconds. that's it. that's the whole function. go take a nap bestie ๐ด๐
Added in version 1.34.0.
โจ String manipulation functions โจ
these string utilities are needed internally for dealing with Windows, and they're exported so clients can work uniformly with this data when the libuv API isn't complete. they're the little helpers that got promoted ๐
size_t uv_utf16_length_as_wtf8(const uint16_t *utf16, ssize_t utf16_len)
gets the length of a UTF-16 (or UCS-2) utf16 value after converting it to WTF-8. if utf16 is NUL terminated, utf16_len can be set to -1; otherwise it must be specified. that -1 is the "trust me, it's terminated" signal ๐ฆ
Added in version 1.47.0.
int uv_utf16_to_wtf8(const uint16_t *utf16, ssize_t utf16_len, char **wtf8_ptr, size_t *wtf8_len_ptr)
converts UTF-16 (or UCS-2) data in utf16 to WTF-8 data in *wtf8_ptr. the utf16_len count (in characters) gives the length of utf16. if utf16 is NUL terminated, utf16_len can be set to -1; otherwise it must be specified. and okay, there are like four whole modes here, pay attention bestie:
- if
wtf8_ptrisNULL, no result will be computed, but the length (equal touv_utf16_length_as_wtf8) will be stored inwtf8_len_ptr. - if
*wtf8_ptrisNULL, space for the conversion will be allocated and returned inwtf8_ptr, and the length will be returned inwtf8_len_ptr. - otherwise, the length of
*wtf8_ptrmust be passed inwtf8_len_ptr.wtf8_ptrmust contain an extra space for an extra NUL after the result. - if the result is truncated,
UV_ENOBUFSwill be returned andwtf8_len_ptrwill be the length of the requiredwtf8_ptrto contain the whole result.
Added in version 1.47.0.
ssize_t uv_wtf8_length_as_utf16(const char *wtf8)
gets the length in characters of a NUL-terminated WTF-8 wtf8 value after converting it to UTF-16 (or UCS-2) โ and yes, that includes the NUL terminator. it counts the terminator. it's thorough like that ๐
Added in version 1.47.0.
void uv_wtf8_to_utf16(const char *utf8, uint16_t *utf16, size_t utf16_len)
converts NUL-terminated WTF-8 data in wtf8 (the signature calls the param utf8, we're not gonna fight about it, iykyk ๐) to UTF-16 (or UCS-2) data in utf16. the utf16_len count (in characters) must include space for the NUL terminator. don't forget the terminator or it's gonna be a whole thing.
Added in version 1.47.0.
๐ Metrics operations ๐
libuv provides a metrics API to track various internal operations of the event loop. it's basically the event loop's screen time report โญ
๐ Data types ๐
type uv_metrics_t
the struct that contains event loop metrics. pro tip: it's recommended to retrieve these metrics in a uv_prepare_cb so you can make sure there are no inconsistencies with the metrics counters. like checking your stats at a moment when nothing's mid-update ๐ซถ
typedef struct {
uint64_t loop_count;
uint64_t events;
uint64_t events_waiting;
/* private */
uint64_t* reserved[13];
} uv_metrics_t;
๐ธ Public members ๐ธ
uint64_t uv_metrics_t.loop_countโ number of event loop iterations. every lap counts ๐ซuint64_t uv_metrics_t.eventsโ number of events that have been processed by the event handler.uint64_t uv_metrics_t.events_waitingโ number of events that were waiting to be processed when the event provider was called. the little queue of "we'll get to you" ๐
๐ฆ API ๐ฆ
uint64_t uv_metrics_idle_time(uv_loop_t *loop)
retrieves the amount of time the event loop has been idle in the kernel's event provider (e.g. epoll_wait). and good news โ this call is thread safe. no warnings here, she's well behaved โจ๐
...The return value is literally the accumulated time spent idle in the kernel's event provider, starting from when that uv_loop_t was configured to collect the idle time. ๐
Note: the event loop will not begin accumulating the event provider's idle time until you calluv_loop_configurewithUV_METRICS_IDLE_TIME. Configure first, metrics later, bestie. ๐ซถ
Added in version 1.39.0. โจ
int uv_metrics_info(uv_loop_t *loop, uv_metrics_t *metrics)โ copies the current set of event loop metrics over to the metrics pointer. That's it, that's the whole job. ๐
Added in version 1.45.0.
๐ธ USER GUIDE ๐ธ
Warning: the contents of this guide have been recently incorporated into the libuv documentation and it hasn't gone through thorough review yet. If you spot a mistake please file an issue, or better yet, open a pull request! ๐
๐ฑ Introduction
This 'book' is a small set of tutorials about using libuv (https://github.com/libuv/libuv) as a high performance evented I/O library which offers the same API on Windows and Unix.
It's meant to cover the main areas of libuv, but it is not a comprehensive reference discussing every function and data structure. For full details, the official libuv documentation (https://docs.libuv.org/en/v1.x/) may be consulted. ๐
This book is still a work in progress, so sections may be incomplete, but I hope you'll enjoy it as it grows. ๐ฑ
๐ซถ Who this book is for
If you're reading this book, you are either:
- a systems programmer, creating low-level programs such as daemons or network services and clients. You've found that the event loop approach is well suited for your application and decided to use libuv.
- a node.js module writer, who wants to wrap platform APIs written in C or C++ with a set of (a)synchronous APIs that are exposed to JavaScript. You'll use libuv purely in the context of node.js. For this you'll require some other resources as the book does not cover parts specific to v8/node.js.
This book assumes that you're comfortable with the C programming language. ๐
๐ Background
The node.js (https://nodejs.org) project began in 2009 as a JavaScript environment decoupled from the browser. Using Google's V8 (https://v8.dev) and Marc Lehmann's libev (http://software.schmorp.de/pkg/libev.html), node.js combined a model of I/O โ evented โ with a language that was well suited to the style of programming; due to the way it had been shaped by browsers. As node.js grew in popularity, it was important to make it work on Windows, but libev ran only on Unix. The Windows equivalent of kernel event notification mechanisms like kqueue or (e)poll is IOCP. libuv was an abstraction around libev or IOCP depending on the platform, providing users an API based on libev. In the node-v0.9.0 version of libuv libev was removed (https://github.com/joyent/libuv/issues/485). ๐ญ
Since then libuv has continued to mature and become a high quality standalone library for system programming. Users outside of node.js include Mozilla's Rust (https://rust-lang.org/) programming language, and a variety (https://github.com/libuv/libuv/blob/v1.x/LINKS.md) of language bindings. ๐ฆ
This book and the code is based on libuv version v1.42.0 (https://github.com/libuv/libuv/releases/tag/v1.42.0).
๐ป Code
All the example code and the source of the book is included as part of the libuv (https://github.com/libuv/libuv) project on GitHub. Clone or Download libuv (https://github.com/libuv/libuv), then build it:
sh autogen.sh
./configure
make
There is no need to make install. To build the examples run make in the docs/code/ directory. ๐ ๏ธ
โจ Basics of libuv
libuv enforces an asynchronous, event-driven style of programming. Its core job is to provide an event loop and callback based notifications of I/O and other activities. libuv offers core utilities like timers, non-blocking networking support, asynchronous file system access, child processes and more. ๐
๐ Event loops
In event-driven programming, an application expresses interest in certain events and responds to them when they occur. The responsibility of gathering events from the operating system or monitoring other sources of events is handled by libuv, and the user can register callbacks to be invoked when an event occurs. The event-loop usually keeps running forever. In pseudocode:
while there are still events to process:
e = get the next event
if there is a callback associated with e:
call the callback
Some examples of events are:
- File is ready for writing
- A socket has data ready to be read
- A timer has timed out
This event loop is encapsulated by uv_run() โ the end-all function when using libuv. ๐
The most common activity of systems programs is to deal with input and output, rather than a lot of number-crunching. The problem with using conventional input/output functions (read, fprintf, etc.) is that they are blocking. The actual write to a hard disk or reading from a network takes a disproportionately long time compared to the speed of the processor. The functions don't return until the task is done, so that your program is doing nothing. For programs which require high performance this is a major roadblock as other activities and other I/O operations are kept waiting. ๐
One of the standard solutions is to use threads. Each blocking I/O operation is started in a separate thread (or in a thread pool). When the blocking function gets invoked in the thread, the operating system can schedule another thread to run, which actually needs the CPU.
The approach followed by libuv uses another style, which is the asynchronous, non-blocking style. Most modern operating systems provide event notification subsystems. For example, a normal read call on a socket would block until the sender actually sent something. Instead, the application can request the operating system to watch the socket and put an event notification in the queue. The application can inspect the events at its convenience (perhaps doing some number crunching before to use the processor to the maximum) and grab the data. It is asynchronous because the application expressed interest at one point, then used the data at another point (in time and space). It is non-blocking because the application process was free to do other tasks. This fits in well with libuv's event-loop approach, since the operating system events can be treated as just another libuv event. The non-blocking ensures that other events can continue to be handled as fast as they come in [1]. ๐ฅ
Note: how the I/O is run in the background is not of our concern, but due to the way our computer hardware works, with the thread as the basic unit of the processor, libuv and OSes will usually run background/worker threads and/or polling to perform tasks in a non-blocking manner.
Bert Belder, one of the libuv core developers, has a small video explaining the architecture of libuv and its background. If you have no prior experience with libuv, it is a quick, useful watch. ๐
libuv's event loop is explained in more detail in the documentation (https://docs.libuv.org/en/v1.x/design.html#the-i-o-loop).
๐ Hello World
With the basics out of the way, let's write our first libuv program. It does nothing, except start a loop which will exit immediately. ๐
helloworld/main.c
#include <stdio.h>
#include <stdlib.h>
#include <uv.h>
int main() {
uv_loop_t *loop = malloc(sizeof(uv_loop_t));
uv_loop_init(loop);
printf("Now quitting.\n");
uv_run(loop, UV_RUN_DEFAULT);
uv_loop_close(loop);
free(loop);
return 0;
}
This program quits immediately because it has no events to process. A libuv event loop has to be told to watch out for events using the various API functions.
Starting with libuv v1.0, users should allocate the memory for the loops before initializing it with uv_loop_init(uv_loop_t *). This allows you to plug in custom memory management. Remember to de-initialize the loop using uv_loop_close(uv_loop_t *) and then delete the storage. The examples never close loops since the program quits after the loop ends and the system will reclaim memory. Production grade projects, especially long running systems programs, should take care to release correctly. ๐ซถ
๐ Default loop
A default loop is provided by libuv and can be accessed using uv_default_loop(). You should use this loop if you only want a single loop. โจ
default-loop/main.c
#include <stdio.h>
#include <uv.h>
int main() {
uv_loop_t *loop = uv_default_loop();
printf("Default loop.\n");
uv_run(loop, UV_RUN_DEFAULT);
uv_loop_close(loop);
return 0;
}
Note: node.js uses the default loop as its main loop. If you are writing bindings you should be aware of this. ๐
๐ Error handling
Initialization functions or synchronous functions which may fail return a negative number on error. Async functions that may fail will pass a status parameter to their callbacks. The error messages are defined as UV_E* constants (https://docs.libuv.org/en/v1.x/errors.html#error-constants).
You can use the uv_strerror(int) and uv_err_name(int) functions to get a const char * describing the error or the error name respectively. ๐
I/O read callbacks (such as for files and sockets) are passed a parameter nread. If nread is less than 0, there was an error (UV_EOF is the end of file error, which you may want to handle differently). ๐
๐ Handles and Requests
libuv works by the user expressing interest in particular events. This is usually done by creating a handle to an I/O device, timer or process. Handles are opaque structs named as uv_TYPE_t where type signifies what the handle is used for.
libuv watchers:
/* Handle types. */
typedef struct uv_loop_s uv_loop_t;
typedef struct uv_handle_s uv_handle_t;
typedef struct uv_dir_s uv_dir_t;
typedef struct uv_stream_s uv_stream_t;
typedef struct uv_tcp_s uv_tcp_t;
typedef struct uv_udp_s uv_udp_t;
typedef struct uv_pipe_s uv_pipe_t;
typedef struct uv_tty_s uv_tty_t;
typedef struct uv_poll_s uv_poll_t;
typedef struct uv_timer_s uv_timer_t;
typedef struct uv_prepare_s uv_prepare_t;
typedef struct uv_check_s uv_check_t;
typedef struct uv_idle_s uv_idle_t;
typedef struct uv_async_s uv_async_t;
typedef struct uv_process_s uv_process_t;
typedef struct uv_fs_event_s uv_fs_event_t;
typedef struct uv_fs_poll_s uv_fs_poll_t;
typedef struct uv_signal_s uv_signal_t;
/* Request types. */
typedef struct uv_req_s uv_req_t;
typedef struct uv_getaddrinfo_s uv_getaddrinfo_t;
typedef struct uv_getnameinfo_s uv_getnameinfo_t;
typedef struct uv_shutdown_s uv_shutdown_t;
typedef struct uv_write_s uv_write_t;
typedef struct uv_connect_s uv_connect_t;
typedef struct uv_udp_send_s uv_udp_send_t;
typedef struct uv_fs_s uv_fs_t;
typedef struct uv_work_s uv_work_t;
typedef struct uv_random_s uv_random_t;
/* None of the above. */
typedef struct uv_env_item_s uv_env_item_t;
typedef struct uv_cpu_info_s uv_cpu_info_t;
typedef struct uv_interface_address_s uv_interface_address_t;
typedef struct uv_dirent_s uv_dirent_t;
typedef struct uv_passwd_s uv_passwd_t;
typedef struct uv_utsname_s uv_utsname_t;
typedef struct uv_statfs_s uv_statfs_t;
Okay so handles are the long-lived girlies ๐
โ they represent objects that stick around. And any async operation you do on one of those handles gets identified with a request. A request is short-lived (usually it only lives across a single callback) and it basically says "here's one I/O operation happening on a handle." โจ Requests exist to preserve context between when you start something and when its callback fires. Example time: a UDP socket is a uv_udp_t, but each individual write to that socket uses a uv_udp_send_t struct that gets passed to the callback once the write is done. iykyk ๐
Handles get set up by their matching init function, and it goes like this:
uv_TYPE_init(uv_loop_t *, uv_TYPE_t *)
Callbacks are the functions libuv calls whenever an event the watcher cares about has happened ๐. Your app-specific logic lowkey lives in the callback. Like, an IO watcher's callback gets the data read from a file, a timer callback fires on timeout, and so on. Main character energy fr fr ๐
๐ค Idling
Here's an example of using an idle handle โ the callback gets called once on every single turn of the event loop. A use case for idle handles is discussed in Utilities <>. Let's use an idle watcher to peek at the watcher life cycle and see how uv_run() will now block because a watcher is present ๐ฆ. The idle watcher gets stopped when the count is reached, and then uv_run() exits since no event watchers are active. Slay.
idle-basic/main.c
#include <stdio.h>
#include <uv.h>
int64_t counter = 0;
void wait_for_a_while(uv_idle_t* handle) {
counter++;
if (counter >= 10e6)
uv_idle_stop(handle);
}
int main() {
uv_idle_t idler;
uv_idle_init(uv_default_loop(), &idler);
uv_idle_start(&idler, wait_for_a_while);
printf("Idling...\n");
uv_run(uv_default_loop(), UV_RUN_DEFAULT);
uv_loop_close(uv_default_loop());
return 0;
}
๐ Storing context
In callback-based programming style you're gonna constantly want to pass some 'context' โ application-specific info, bestie โ between the call site and the callback. Good news: all handles and requests have a void* data member that you can set to your context and then cast back inside the callback ๐. This is a super common pattern all over the C library ecosystem, no cap. And bonus: uv_loop_t has a similar data member too. ๐
[1] Depending on the capacity of the hardware of course. ๐ญ
๐๏ธ Filesystem
Simple filesystem read/write is achieved using the uv_fs_* functions and the uv_fs_t struct. Easy.
Note: the libuv filesystem operations are different from socket operations <>. Socket operations use the non-blocking operations provided by the operating system. Filesystem operations use blocking functions internally, but invoke these functions in a thread pool (https://docs.libuv.org/en/v1.x/threadpool.html#thread-pool-work-scheduling) and notify watchers registered with the event loop when application interaction is required. ๐ง
All filesystem functions have two forms โ synchronous and asynchronous โจ.
The synchronous forms automatically get called (and block) if the callback is null. The return value of functions is a libuv error code <#libuv-error-handling>. This is usually only useful for synchronous calls. The asynchronous form is called when a callback is passed, and the return value is 0. ๐
๐ Reading/Writing files
A file descriptor is obtained using:
int uv_fs_open(uv_loop_t* loop, uv_fs_t* req, const char* path, int flags, int mode, uv_fs_cb cb)
flags and mode are standard Unix flags (https://man7.org/linux/man-pages/man2/open.2.html). libuv takes care of converting to the appropriate Windows flags ๐ช.
File descriptors are closed using:
int uv_fs_close(uv_loop_t* loop, uv_fs_t* req, uv_file file, uv_fs_cb cb)
Filesystem operation callbacks have the signature:
void callback(uv_fs_t* req);
Let's see a simple implementation of cat. We start with registering a callback for when the file is opened:
uvcat/main.c - opening a file
// The request passed to the callback is the same as the one the call setup
// function was passed.
assert(req == &open_req);
if (req->result >= 0) {
iov = uv_buf_init(buffer, sizeof(buffer));
uv_fs_read(uv_default_loop(), &read_req, req->result,
&iov, 1, -1, on_read);
}
else {
fprintf(stderr, "error opening file: %s\n", uv_strerror((int)req->result));
}
}
The result field of a uv_fs_t is the file descriptor in the case of the uv_fs_open callback. If the file is successfully opened, we start reading it ๐โจ
uvcat/main.c - read callback
if (req->result < 0) {
fprintf(stderr, "Read error: %s\n", uv_strerror(req->result));
}
else if (req->result == 0) {
uv_fs_t close_req;
// synchronous
uv_fs_close(uv_default_loop(), &close_req, open_req.result, NULL);
}
else if (req->result > 0) {
iov.len = req->result;
uv_fs_write(uv_default_loop(), &write_req, 1, &iov, 1, -1, on_write);
}
}
In the case of a read call, you should pass an initialized buffer which will be filled with data before the read callback is triggered. The uv_fs_* operations map almost directly to certain POSIX functions, so EOF is indicated in this case by result being 0. In the case of streams or pipes, the UV_EOF constant would have been passed as a status instead ๐ธ.
Here you see a common pattern when writing asynchronous programs: the uv_fs_close() call is performed synchronously. Usually tasks which are one-off, or are done as part of the startup or shutdown stage, are performed synchronously, since we're interested in fast I/O when the program is going about its primary task and dealing with multiple I/O sources. For solo tasks the performance difference usually is negligible and may lead to simpler code ๐
โจ.
Filesystem writing is similarly simple using uv_fs_write(). Your callback will be triggered after the write is complete. In our case the callback simply drives the next read. Thus read and write proceed in lockstep via callbacks ๐ซถ.
uvcat/main.c - write callback
if (req->result < 0) {
fprintf(stderr, "Write error: %s\n", uv_strerror((int)req->result));
}
else {
uv_fs_read(uv_default_loop(), &read_req, open_req.result, &iov, 1, -1, on_read);
}
}
Warning: due to the way filesystems and disk drives are configured for performance, a write that 'succeeds' may not be committed to disk yet. ๐ญ bestie do not assume it's safely on disk, fr fr.
We set the dominos rolling in main():
uvcat/main.c
uv_fs_open(uv_default_loop(), &open_req, argv[1], O_RDONLY, 0, on_open);
uv_run(uv_default_loop(), UV_RUN_DEFAULT);
uv_fs_req_cleanup(&open_req);
uv_fs_req_cleanup(&read_req);
uv_fs_req_cleanup(&write_req);
return 0;
}
Warning: the uv_fs_req_cleanup() function must always be called on filesystem requests to free internal memory allocations in libuv. Like, every single time. No skipping, no "it's probably fine" ๐๐
๐งฐ Filesystem operations
All the standard filesystem operations like unlink, rmdir, stat are supported asynchronously and have intuitive argument order ๐. They follow the same patterns as the read/write/open calls, returning the result in the uv_fs_t.result field. The full list:
Filesystem operations
int uv_fs_close(uv_loop_t* loop, uv_fs_t* req, uv_file file, uv_fs_cb cb);
int uv_fs_open(uv_loop_t* loop, uv_fs_t* req, const char* path, int flags, int mode, uv_fs_cb cb);
int uv_fs_read(uv_loop_t* loop, uv_fs_t* req, uv_file file, const uv_buf_t bufs[], unsigned int nbufs, int64_t offset, uv_fs_cb cb);
int uv_fs_unlink(uv_loop_t* loop, uv_fs_t* req, const char* path, uv_fs_cb cb);
int uv_fs_write(uv_loop_t* loop, uv_fs_t* req, uv_file file, const uv_buf_t bufs[], unsigned int nbufs, int64_t offset, uv_fs_cb cb);
int uv_fs_copyfile(uv_loop_t* loop, uv_fs_t* req, const char* path, const char* new_path, int flags, uv_fs_cb cb);
int uv_fs_mkdir(uv_loop_t* loop, uv_fs_t* req, const char* path, int mode, uv_fs_cb cb);
int uv_fs_mkdtemp(uv_loop_t* loop, uv_fs_t* req, const char* tpl, uv_fs_cb cb);
int uv_fs_mkstemp(uv_loop_t* loop, uv_fs_t* req, const char* tpl, uv_fs_cb cb);
int uv_fs_rmdir(uv_loop_t* loop, uv_fs_t* req, const char* path, uv_fs_cb cb);
int uv_fs_scandir(uv_loop_t* loop, uv_fs_t* req, const char* path, int flags, uv_fs_cb cb);
int uv_fs_scandir_next(uv_fs_t* req, uv_dirent_t* ent);
int uv_fs_opendir(uv_loop_t* loop, uv_fs_t* req, const char* path, uv_fs_cb cb);
int uv_fs_readdir(uv_loop_t* loop, uv_fs_t* req, uv_dir_t* dir, uv_fs_cb cb);
int uv_fs_closedir(uv_loop_t* loop, uv_fs_t* req, uv_dir_t* dir, uv_fs_cb cb);
int uv_fs_stat(uv_loop_t* loop, uv_fs_t* req, const char* path, uv_fs_cb cb);
int uv_fs_fstat(uv_loop_t* loop, uv_fs_t* req, uv_file file, uv_fs_cb cb);
int uv_fs_rename(uv_loop_t* loop, uv_fs_t* req, const char* path, const char* new_path, uv_fs_cb cb);
int uv_fs_fsync(uv_loop_t* loop, uv_fs_t* req, uv_file file, uv_fs_cb cb);
int uv_fs_fdatasync(uv_loop_t* loop, uv_fs_t* req, uv_file file, uv_fs_cb cb);
int uv_fs_ftruncate(uv_loop_t* loop, uv_fs_t* req, uv_file file, int64_t offset, uv_fs_cb cb);
int uv_fs_sendfile(uv_loop_t* loop, uv_fs_t* req, uv_file out_fd, uv_file in_fd, int64_t in_offset, size_t length, uv_fs_cb cb);
int uv_fs_access(uv_loop_t* loop, uv_fs_t* req, const char* path, int mode, uv_fs_cb cb);
int uv_fs_chmod(uv_loop_t* loop, uv_fs_t* req, const char* path, int mode, uv_fs_cb cb);
int uv_fs_utime(uv_loop_t* loop, uv_fs_t* req, const char* path, double atime, double mtime, uv_fs_cb cb);
int uv_fs_futime(uv_loop_t* loop, uv_fs_t* req, uv_file file, double atime, double mtime, uv_fs_cb cb);
int uv_fs_lutime(uv_loop_t* loop, uv_fs_t* req, const char* path, double atime, double mtime, uv_fs_cb cb);
int uv_fs_lstat(uv_loop_t* loop, uv_fs_t* req, const char* path, uv_fs_cb cb);
int uv_fs_link(uv_loop_t* loop, uv_fs_t* req, const char* path, const char* new_path, uv_fs_cb cb);
int uv_fs_symlink(uv_loop_t* loop, uv_fs_t* req, const char* path, const char* new_path, int flags, uv_fs_cb cb);
int uv_fs_readlink(uv_loop_t* loop, uv_fs_t* req, const char* path, uv_fs_cb cb);
int uv_fs_realpath(uv_loop_t* loop, uv_fs_t* req, const char* path, uv_fs_cb cb);
int uv_fs_fchmod(uv_loop_t* loop, uv_fs_t* req, uv_file file, int mode, uv_fs_cb cb);
int uv_fs_chown(uv_loop_t* loop, uv_fs_t* req, const char* path, uv_uid_t uid, uv_gid_t gid, uv_fs_cb cb);
int uv_fs_fchown(uv_loop_t* loop, uv_fs_t* req, uv_file file, uv_uid_t uid, uv_gid_t gid, uv_fs_cb cb);
int uv_fs_lchown(uv_loop_t* loop, uv_fs_t* req, const char* path, uv_uid_t uid, uv_gid_t gid, uv_fs_cb cb);
int uv_fs_statfs(uv_loop_t* loop, uv_fs_t* req, const char* path, uv_fs_cb cb);
๐ฆ Buffers and Streams ๐ฆ
ok so the basic I/O handle in libuv is the stream (uv_stream_t). like, TCP sockets, TTYs, and pipes for file I/O and IPC are all treated as stream subclasses. one handle type to rule them all, honestly iconic. ๐
Streams get initialized using custom functions for each subclass, and then you operate on them using:
int uv_read_start(uv_stream_t*, uv_alloc_cb alloc_cb, uv_read_cb read_cb);
int uv_read_stop(uv_stream_t*);
int uv_write(uv_write_t* req, uv_stream_t* handle,
const uv_buf_t bufs[], unsigned int nbufs, uv_write_cb cb);
The stream-based functions are way simpler to use than the filesystem ones, and libuv will automatically keep reading from a stream once uv_read_start() is called โ like once and done, bestie โ until you call uv_read_stop(). ๐ซถ
The discrete unit of data is the buffer โ uv_buf_t. It's literally just a collection of a pointer to bytes (uv_buf_t.base) and the length (uv_buf_t.len). The uv_buf_t itself is lightweight and gets passed around by value. What actually needs managing is the real bytes, which have to be allocated and freed by the application. that's you. that's the assignment. ๐
Error: THIS PROGRAM DOES NOT ALWAYS WORK, NEED SOMETHING BETTER
To demonstrate streams we're gonna need uv_pipe_t. This lets you stream local files [2]. Here's a simple little tee utility using libuv. Doing all operations asynchronously shows the power of evented I/O โ the two writes won't block each other, but we have to be careful to copy over the buffer data to ensure we don't free a buffer until it has been written. โจ
The program is to be executed as:
./uvtee <output_file>
We start off opening pipes on the files we require. libuv pipes to a file are opened as bidirectional by default. cute, right? ๐
uvtee/main.c โ read on pipes
loop = uv_default_loop();
uv_pipe_init(loop, &stdin_pipe, 0);
uv_pipe_open(&stdin_pipe, 0);
uv_pipe_init(loop, &stdout_pipe, 0);
uv_pipe_open(&stdout_pipe, 1);
uv_fs_t file_req;
int fd = uv_fs_open(loop, &file_req, argv[1], O_CREAT | O_RDWR, 0644, NULL);
uv_pipe_init(loop, &file_pipe, 0);
uv_pipe_open(&file_pipe, fd);
uv_read_start((uv_stream_t*)&stdin_pipe, alloc_buffer, read_stdin);
uv_run(loop, UV_RUN_DEFAULT);
return 0;
}
The third argument of uv_pipe_init() should be set to 1 for IPC using named pipes. That's covered in Processes <>. The uv_pipe_open() call associates the pipe with the file descriptor โ in this case 0 (standard input). ๐
We start monitoring stdin. The alloc_buffer callback is invoked as new buffers are required to hold incoming data. read_stdin will be called with these buffers.
uvtee/main.c โ reading buffers
*buf = uv_buf_init((char*) malloc(suggested_size), suggested_size);
}
void free_write_req(uv_write_t *req) {
if (nread < 0){
if (nread == UV_EOF){
// end of file
uv_close((uv_handle_t *)&stdin_pipe, NULL);
uv_close((uv_handle_t *)&stdout_pipe, NULL);
uv_close((uv_handle_t *)&file_pipe, NULL);
}
} else if (nread > 0) {
write_data((uv_stream_t *)&stdout_pipe, nread, *buf, on_stdout_write);
write_data((uv_stream_t *)&file_pipe, nread, *buf, on_file_write);
}
// OK to free buffer as write_data copies it.
if (buf->base)
free(buf->base);
}
The standard malloc is sufficient here, but ngl you can use any memory allocation scheme. For example, node.js uses its own slab allocator which associates buffers with V8 objects. fancy.
The read callback's nread parameter is less than 0 on any error. This error might be EOF, in which case we close all the streams, using the generic close function uv_close() which deals with the handle based on its internal type. Otherwise nread is a non-negative number and we can attempt to write that many bytes to the output streams. And finally โ remember that buffer allocation and deallocation is application responsibility, so we free the data. ๐ง
The allocation callback may return a buffer with length zero if it fails to allocate memory. In that case, the read callback is invoked with error UV_ENOBUFS. But heads up โ libuv will continue to attempt to read the stream though, so you must explicitly call uv_close() if you want to stop when allocation fails. like, it's not gonna stop for you. ๐
The read callback may be called with nread = 0, indicating that at this point there is nothing to be read. Most applications will just ignore this. mood, honestly.
uvtee/main.c โ Write to pipe
uv_write_t req;
uv_buf_t buf;
} write_req_t;
uv_loop_t *loop;
write_req_t *wr = (write_req_t*) req;
free(wr->buf.base);
free(wr);
}
void on_stdout_write(uv_write_t *req, int status) {
free_write_req(req);
}
void on_file_write(uv_write_t *req, int status) {
free_write_req(req);
}
void write_data(uv_stream_t *dest, size_t size, uv_buf_t buf, uv_write_cb cb) {
write_req_t *req = (write_req_t*) malloc(sizeof(write_req_t));
req->buf = uv_buf_init((char*) malloc(size), size);
memcpy(req->buf.base, buf.base, size);
uv_write((uv_write_t*) req, (uv_stream_t*)dest, &req->buf, 1, cb);
}
write_data() makes a copy of the buffer obtained from read. This buffer does not get passed through to the write callback triggered on write completion. To get around this we wrap a write request and a buffer in write_req_t and unwrap it in the callbacks. We make a copy so we can free the two buffers from the two calls to write_data independently of each other. While acceptable for a demo program like this, you'll probably want smarter memory management โ like reference counted buffers or a pool of buffers โ in any major application. โจ
Warning: If your program is meant to be used with other programs it may knowingly or unknowingly be writing to a pipe. This makes it susceptible to aborting on receiving aSIGPIPEโ see the whole thing at <http://pod.tst.eu/http://cvs.schmorp.de/libev/ev.pod#The_special_problem_of_SIGPIPE>. It is a good idea to insert:c signal(SIGPIPE, SIG_IGN)in the initialization stages of your application. protect ur peace, bestie. ๐ซถ
๐ธ File change events ๐ธ
All modern operating systems provide APIs to put watches on individual files or directories and be informed when the files are modified. libuv wraps common file change notification libraries [1]. Ngl this is one of the more inconsistent parts of libuv โ file change notification systems are themselves extremely varied across platforms, so getting everything working everywhere is difficult. it's giving chaos. ๐ญ
To demonstrate, I'm going to build a simple utility which runs a command whenever any of the watched files change:
./onchange <command> <file1> [file2] ...
Note: Currently this example only works on OSX and Windows. Refer to the notes of the uv_fs_event_start function โ <https://docs.libuv.org/en/v1.x/fs_event.html#c.uv_fs_event_start>.
The file change notification is started using uv_fs_event_init():
onchange/main.c โ The setup
int main(int argc, char **argv) {
if (argc <= 2) {
fprintf(stderr, "Usage: %s <command> <file1> [file2 ...]\n", argv[0]);
return 1;
}
loop = uv_default_loop();
command = argv[1];
while (argc-- > 2) {
fprintf(stderr, "Adding watch on %s\n", argv[argc]);
uv_fs_event_t *fs_event_req = malloc(sizeof(uv_fs_event_t));
uv_fs_event_init(loop, fs_event_req);
// The recursive flag watches subdirectories too.
uv_fs_event_start(fs_event_req, run_command, argv[argc], UV_FS_EVENT_RECURSIVE);
}
return uv_run(loop, UV_RUN_DEFAULT);
}
So yeah โ that third argument is the actual file or directory you're monitoring ๐ and the last one, flags, can be any of these lil beauties:
/*
* Flags to be passed to uv_fs_event_start().
*/
enum uv_fs_event_flags {
UV_FS_EVENT_WATCH_ENTRY = 1,
UV_FS_EVENT_STAT = 2,
UV_FS_EVENT_RECURSIVE = 4
};
Real talk: UV_FS_EVENT_WATCH_ENTRY and UV_FS_EVENT_STAT don't do anything (yet ๐). UV_FS_EVENT_RECURSIVE will start watching subdirectories too on supported platforms. That's the one that actually eats. โจ
Your callback gets handed these four things, in order:
uv_fs_event_t *handleโ the handle, obviously. Itspathfield is the file the watch was set on. ๐const char *filenameโ if you're monitoring a directory, this is the file that changed. Only non-null on Linux and Windows, and ngl it may be null even on those platforms ๐ญint eventsโ one ofUV_RENAMEorUV_CHANGE, or a bitwise OR of both.int statusโ ifstatus < 0, there's a libuv error (#libuv-error-handling). ๐
In our example we literally just print the arguments and run the command using system().
onchange/main.c โ file change notification callback
void run_command(uv_fs_event_t *handle, const char *filename, int events, int status) {
char path[1024];
size_t size = 1023;
// Does not handle error if path is longer than 1023.
uv_fs_event_getpath(handle, path, &size);
path[size] = '\0';
fprintf(stderr, "Change detected in %s: ", path);
if (events & UV_RENAME)
fprintf(stderr, "renamed");
if (events & UV_CHANGE)
fprintf(stderr, "changed");
fprintf(stderr, " %s\n", filename ? filename : "");
system(command);
}
Footnotes, bestie, don't skip 'em ๐ซถ
[1]inotify on Linux, FSEvents on Darwin, kqueue on BSDs, ReadDirectoryChangesW on Windows, event ports on Solaris, unsupported on Cygwin[2]see Parent-child IPC (#pipes)
๐ Networking ๐
Okay so networking in libuv? Not much different from directly using the BSD socket interface โ some things are easier, all are non-blocking, but the concepts stay the exact same, no cap. On top of that, libuv offers utility functions to abstract the annoying, repetitive and low-level tasks, like setting up sockets using the BSD socket structures, DNS lookup, and tweaking various socket parameters. It's giving glow-up for your socket code ๐
The uv_tcp_t and uv_udp_t structures are what you use for network I/O. ๐
Note: the code samples in this chapter exist to show certain libuv APIs. They are not examples of good quality code. They leak memory and don't always close connections properly. ๐ญ Do not copy-paste these into prod, I'm begging.
๐งต TCP ๐งต
TCP is a connection oriented, stream protocol and is therefore based on the libuv streams infrastructure. Periodt.
๐ฅ๏ธ Server ๐ฅ๏ธ
Server sockets proceed like this, step by step:
uv_tcp_initthe TCP handle.uv_tcp_bindit.- Call
uv_listenon the handle to have a callback invoked whenever a new connection is established by a client. - Use
uv_acceptto accept the connection. - Use stream operations (
#buffers-and-streams) to communicate with the client.
Here is a simple echo server ๐
tcp-echo-server/main.c โ The listen socket
uv_close((uv_handle_t*) client, on_close);
}
}
int main() {
loop = uv_default_loop();
uv_tcp_t server;
uv_tcp_init(loop, &server);
uv_ip4_addr("0.0.0.0", DEFAULT_PORT, &addr);
uv_tcp_bind(&server, (const struct sockaddr*)&addr, 0);
int r = uv_listen((uv_stream_t*) &server, DEFAULT_BACKLOG, on_new_connection);
if (r) {
fprintf(stderr, "Listen error %s\n", uv_strerror(r));
return 1;
}
return uv_run(loop, UV_RUN_DEFAULT);
}
You can see the utility function uv_ip4_addr being used to convert from a human readable IP address + port pair into the sockaddr_in structure that the BSD socket APIs require. And the reverse? That's uv_ip4_name. ๐
Note: there are uv_ip6_* analogues for the ip4 functions. ๐ฆ
Most of the setup functions are synchronous since they are CPU-bound. uv_listen is where we return to libuv's callback style. The second arguments is the backlog queue โ the maximum length of queued connections. ๐
When a connection is initiated by clients, the callback is required to set up a handle for the client socket and associate the handle using uv_accept. In this case we also establish interest in reading from this stream. ๐
tcp-echo-server/main.c โ Accepting the client
free(buf->base);
}
void on_new_connection(uv_stream_t *server, int status) {
if (status < 0) {
fprintf(stderr, "New connection error %s\n", uv_strerror(status));
// error!
return;
}
uv_tcp_t *client = (uv_tcp_t*) malloc(sizeof(uv_tcp_t));
uv_tcp_init(loop, client);
if (uv_accept(server, (uv_stream_t*) client) == 0) {
uv_read_start((uv_stream_t*) client, alloc_buffer, echo_read);
}
The remaining set of functions is very similar to the streams example and can be found in the code. Just remember to call uv_close when the socket isn't required. Bestie you can even do this inside the uv_listen callback if you're not interested in accepting the connection โ no hard feelings ๐
๐ Client ๐
Where you do bind/listen/accept on the server, on the client side it's simply a matter of calling uv_tcp_connect. Same uv_connect_cb style callback as uv_listen is used by uv_tcp_connect. Try: โจ
uv_tcp_t* socket = (uv_tcp_t*)malloc(sizeof(uv_tcp_t));
uv_tcp_init(loop, socket);
uv_connect_t* connect = (uv_connect_t*)malloc(sizeof(uv_connect_t));
struct sockaddr_in dest;
uv_ip4_addr("127.0.0.1", 80, &dest);
uv_tcp_connect(connect, socket, (const struct sockaddr*)&dest, on_connect);
where on_connect will be called after the connection is established. The callback receives the uv_connect_t struct, which has a member .handle pointing to the socket. ๐
๐ก UDP ๐ก
The User Datagram Protocol (https://en.wikipedia.org/wiki/User_Datagram_Protocol) offers connectionless, unreliable network communication. Hence libuv doesn't offer a stream. Instead libuv provides non-blocking UDP support via the uv_udp_t handle (for receiving) and uv_udp_send_t request (for sending) and related functions. That said, the actual API for reading/writing is very similar to normal stream reads. ๐
To look at how UDP can be used, the example shows the first stage of obtaining an IP address from a DHCP (https://datatracker.ietf.org/doc/html/rfc2131) server โ DHCP Discover. ๐ต๏ธโโ๏ธ
Note: you will have to run udp-dhcp as root since it uses well known port numbers below 1024. ๐ฅ
udp-dhcp/main.c โ Setup and send UDP packets
uv_loop_t *loop;
uv_udp_t send_socket;
uv_udp_t recv_socket;
int main() {
loop = uv_default_loop();
uv_udp_init(loop, &recv_socket);
struct sockaddr_in recv_addr;
uv_ip4_addr("0.0.0.0", 68, &recv_addr);
uv_udp_bind(&recv_socket, (const struct sockaddr *)&recv_addr, UV_UDP_REUSEADDR);
uv_udp_recv_start(&recv_socket, alloc_buffer, on_read);
uv_udp_init(loop, &send_socket);
struct sockaddr_in broadcast_addr;
uv_ip4_addr("0.0.0.0", 0, &broadcast_addr);
uv_udp_bind(&send_socket, (const struct sockaddr *)&broadcast_addr, 0);
uv_udp_set_broadcast(&send_socket, 1);
uv_udp_send_t send_req;
uv_buf_t discover_msg = make_discover_msg();
struct sockaddr_in send_addr;
uv_ip4_addr("255.255.255.255", 67, &send_addr);
uv_udp_send(&send_req, &send_socket, &discover_msg, 1, (const struct sockaddr *)&send_addr, on_send);
return uv_run(loop, UV_RUN_DEFAULT);
}
Note: the IP address0.0.0.0is used to bind to all interfaces. The IP address255.255.255.255is a broadcast address meaning that packets will be sent to all interfaces on the subnet. Port0means that the OS randomly assigns a port. ๐ฒ
First we setup the receiving socket to bind on all interfaces on port 68 (DHCP client) and start a read on it. This will read back responses from any DHCP server that replies. We use the UV_UDP_REUSEADDR flag to play nice with any other system DHCP clients that are running on this computer on the same port. ๐ค Then we setup a similar send socket and use uv_udp_send to send a broadcast message on port 67 (DHCP server).
It is necessary to set the broadcast flag, otherwise you will get an EACCES error [1]. ๐ค The exact message being sent is not relevant to this book and you can study the code if you are interested. As usual, the read and write callbacks will receive a status code of < 0 if something went wrong.
Since UDP sockets are not connected to a particular peer, the read callback receives an extra parameter about the sender of the packet. ๐ฌ
nread may be zero if there is no more data to be read. If addr is NULL, it indicates there is nothing to read (the callback shouldn't do anything), if not NULL, it indicates that an empty datagram was received from the host at addr. The flags parameter may be UV_UDP_PARTIAL if the buffer provided by your allocator was not large enough to hold the data. In this case the OS will discard the data that could not fit (That's UDP for you!). ๐
udp-dhcp/main.c โ Reading packets
void on_read(uv_udp_t *req, ssize_t nread, const uv_buf_t *buf, const struct sockaddr *addr, unsigned flags) {
if (nread < 0) {
fprintf(stderr, "Read error %s\n", uv_err_name(nread));
uv_close((uv_handle_t*) req, NULL);
free(buf->base);
return;
}
char sender[17] = { 0 };
uv_ip4_name((const struct sockaddr_in*) addr, sender, 16);
fprintf(stderr, "Recv from %s\n", sender);
// ... DHCP specific code
unsigned int *as_integer = (unsigned int*)buf->base;
unsigned int ipbin = ntohl(as_integer[4]);
unsigned char ip[4] = {0};
int i;
for (i = 0; i < 4; i++)
ip[i] = (ipbin >> i*8) & 0xff;
fprintf(stderr, "Offered IP %d.%d.%d.%d\n", ip[3], ip[2], ip[1], ip[0]);
free(buf->base);
uv_udp_recv_stop(req);
}
๏ฟฝ่ด่ถ UDP Options ๐ฆ
Okay bestie, UDP has some little knobs and honestly theyโre giving โsmall but powerful.โ Letโs go through them.
โณ Time-to-live โณ
The TTL of packets sent on the socket can be changed using uv_udp_set_ttl.
๐ชฉ IPv6 stack only ๐ชฉ
IPv6 sockets can be used for both IPv4 and IPv6 communication. If you want to restrict the socket to IPv6 only, pass the UV_UDP_IPV6ONLY flag to uv_udp_bind.
๐ Multicast ๐
A socket can (un)subscribe to a multicast group using:
where membership is UV_JOIN_GROUP or UV_LEAVE_GROUP.
The concepts of multicasting are nicely explained in this guide <https://tldp.org/HOWTO/Multicast-HOWTO-2.html>.
Local loopback of multicast packets is enabled by default [2], use uv_udp_set_multicast_loop to switch it off.
The packet time-to-live for multicast packets can be changed using uv_udp_set_multicast_ttl.
๐ Querying DNS ๐
libuv provides asynchronous DNS resolution. For this it provides its own getaddrinfo replacement [3]. In the callback you can perform normal socket operations on the retrieved addresses. Letโs connect to Libera.chat to see an example of DNS resolution.
dns/main.c
int main() {
loop = uv_default_loop();
struct addrinfo hints;
hints.ai_family = PF_INET;
hints.ai_socktype = SOCK_STREAM;
hints.ai_protocol = IPPROTO_TCP;
hints.ai_flags = 0;
uv_getaddrinfo_t resolver;
fprintf(stderr, "irc.libera.chat is... ");
int r = uv_getaddrinfo(loop, &resolver, on_resolved, "irc.libera.chat", "6667", &hints);
if (r) {
fprintf(stderr, "getaddrinfo call error %s\n", uv_err_name(r));
return 1;
}
return uv_run(loop, UV_RUN_DEFAULT);
}
If uv_getaddrinfo returns non-zero, something went wrong in the setup and your callback wonโt be invoked at all. All arguments can be freed immediately after uv_getaddrinfo returns. The hostname, servname and hints structures are documented in the getaddrinfo man page <https://man7.org/linux/man-pages/man3/getaddrinfo.3.html>. The callback can be NULL in which case the function will run synchronously.
In the resolver callback, you can pick any IP from the linked list of struct addrinfo(s). This also demonstrates uv_tcp_connect. It is necessary to call uv_freeaddrinfo in the callback.
dns/main.c
void on_resolved(uv_getaddrinfo_t *resolver, int status, struct addrinfo *res) {
if (status < 0) {
fprintf(stderr, "getaddrinfo callback error %s\n", uv_err_name(status));
return;
}
char addr[17] = {'\0'};
uv_ip4_name((struct sockaddr_in*) res->ai_addr, addr, 16);
fprintf(stderr, "%s\n", addr);
uv_connect_t *connect_req = (uv_connect_t*) malloc(sizeof(uv_connect_t));
uv_tcp_t *socket = (uv_tcp_t*) malloc(sizeof(uv_tcp_t));
uv_tcp_init(loop, socket);
uv_tcp_connect(connect_req, socket, (const struct sockaddr*) res->ai_addr, on_connect);
uv_freeaddrinfo(res);
}
libuv also provides the inverse uv_getnameinfo <https://docs.libuv.org/en/v1.x/dns.html#c.uv_getnameinfo>.
๐ Network interfaces ๐
Information about the systemโs network interfaces can be obtained through libuv using uv_interface_addresses. This simple program just prints out all the interface details so you get an idea of the fields that are available. This is useful to allow your service to bind to IP addresses when it starts.
interfaces/main.c
#include <stdio.h>
#include <uv.h>
int main() {
char buf[512];
uv_interface_address_t *info;
int count, i;
uv_interface_addresses(&info, &count);
i = count;
printf("Number of interfaces: %d\n", count);
while (i--) {
uv_interface_address_t interface_a = info[i];
printf("Name: %s\n", interface_a.name);
printf("Internal? %s\n", interface_a.is_internal ? "Yes" : "No");
if (interface_a.address.address4.sin_family == AF_INET) {
uv_ip4_name(&interface_a.address.address4, buf, sizeof(buf));
printf("IPv4 address: %s\n", buf);
}
else if (interface_a.address.address4.sin_family == AF_INET6) {
uv_ip6_name(&interface_a.address.address6, buf, sizeof(buf));
printf("IPv6 address: %s\n", buf);
}
printf("\n");
}
uv_free_interface_addresses(info, count);
return 0;
}
is_internal is true for loopback interfaces. Note that if a physical interface has multiple IPv4/IPv6 addresses, the name will be reported multiple times, with each address being reported once.
- [1] <https://beej.us/guide/bgnet/html/#broadcast-packetshello-world>
- [2] <https://tldp.org/HOWTO/Multicast-HOWTO-6.html#ss6.1>
- [3] libuv use the system
getaddrinfoin the libuv threadpool. libuv v0.8.0 and earlier also included c-ares <https://c-ares.org/> as an alternative, but this has been removed in v0.9.0.
๐งต Threads ๐งต
Wait a minute? Why are we on threads? Arenโt event loops supposed to be the way to do web-scale programming? Well... no. Threads are still the medium in which processors do their jobs. Threads are therefore mighty useful sometimes, even though you might have to wade through various synchronization primitives.
Threads are used internally to fake the asynchronous nature of all of the system calls. libuv also uses threads to allow you, the application, to perform a task asynchronously that is actually blocking, by spawning a thread and collecting the result when it is done.
Today there are two predominant thread libraries: the Windows threads implementation and POSIXโs pthreads(7) <https://man7.org/linux/man-pages/man7/pthreads.7.html>. libuvโs thread API is analogous to the pthreads API and often has similar semantics.
A notable aspect of libuvโs thread facilities is that it is a self contained section within libuv. Whereas other features intimately depend on the event loop and callback principles, threads are complete agnostic, they block as required, signal errors directly via return values, and, as shown in the first example, donโt even require a running event loop.
libuvโs thread API is also very limited since the semantics and syntax of threads are different on all platforms, with different levels of completeness.
This chapter makes the following assumption: There is only one event loop, running in one thread (the main thread). No other thread interacts with the event loop (except using uv_async_send).
๐งต Core thread operations ๐งต
There isnโt much here, you just start a thread using uv_thread_create() and wait for it to close using uv_thread_join().
thread-create/main.c
int tracklen = 10;
uv_thread_t hare_id;
uv_thread_t tortoise_id;
uv_thread_create(&hare_id, hare, &tracklen);
uv_thread_create(&tortoise_id, tortoise, &tracklen);
uv_thread_join(&hare_id);
uv_thread_join(&tortoise_id);
return 0;
}
Tip:uv_thread_tis just an alias forpthread_ton Unix, but this is an implementation detail, avoid depending on it to always be true.
The second parameter is the function which will serve as the entry point for the thread, the last parameter is a void * argument which can be used to pass custom parameters to the thread. The function hare will now run in a separate thread, scheduled pre-emptively by the operating system:
thread-create/main.c
int tracklen = *((int *) arg);
while (tracklen) {
tracklen--;
uv_sleep(1000);
fprintf(stderr, "Hare ran another step\n");
}
fprintf(stderr, "Hare done running!\n");
}
Unlike pthread_join() which allows the target thread to pass back a value to the calling thread using a second parameter, uv_thread_join() does not. To send values use Inter-thread communication.
๐งท Synchronization Primitives ๐งท
This section is purposely spartan. This book is not about threads, so I only catalogue any surprises in the libuv APIs here. For the rest you can look at the pthreads(7) <https://man7.org/linux/man-pages/man7/pthreads.7.html> man pages.
๐ Mutexes ๐
The mutex functions are a direct map to the pthread equivalents.
libuv mutex functions
int uv_mutex_init(uv_mutex_t* handle);
int uv_mutex_init_recursive(uv_mutex_t* handle);
void uv_mutex_destroy(uv_mutex_t* handle);
void uv_mutex_lock(uv_mutex_t* handle);
int uv_mutex_trylock(uv_mutex_t* handle);
void uv_mutex_unlock(uv_mutex_t* handle);
The uv_mutex_init(), uv_mutex_init_recursive() and uv_mutex_trylock() functions will return 0 on success, and an error code otherwise.
If libuv has been compiled with debugging enabled, uv_mutex_destroy(), uv_mutex_lock() and uv_mutex_unlock() will abort() on error. Similarly uv_mutex_trylock() will abort if the error is anything other than EAGAIN or EBUSY.
Recursive mutexes are supported, but you should not rely on them. Also, they should not be used with uv_cond_t variables.
The default BSD mutex implementation will raise an error if a thread which has locked a mutex attempts to lock it again. For example, a construct like:
uv_mutex_init(a_mutex);
uv_mutex_lock(a_mutex);
uv_thread_create(thread_id, entry, (void *)a_mutex);
uv_mutex_lock(a_mutex);
// more things here
can be used to wait until another thread initializes some stuff and then unlocks a_mutex but will lead to your program crashing if in debug mode, or return an error in the second call to uv_mutex_lock().
Note: Mutexes on Windows are always recursive.
๐ Locks ๐
Read-write locks are a more granular access mechanism. Two readers can access shared memory at the same time. A writer may not acquire the lock when it is held by a reader. A reader or writer may not acquire a lock when a writer is holding it. Read-write locks are frequently used in databases. Here is a toy example.
locks/main.c - simple rwlocks
#include <stdio.h>
#include <uv.h>
uv_barrier_t blocker;
uv_rwlock_t numlock;
int shared_num;
void reader(void *n)
{
int num = *(int *)n;
int i;
for (i = 0; i < 20; i++) {
uv_rwlock_rdlock(&numlock);
printf("Reader %d: acquired lock\n", num);
printf("Reader %d: shared num = %d\n", num, shared_num);
uv_rwlock_rdunlock(&numlock);
printf("Reader %d: released lock\n", num);
}
uv_barrier_wait(&blocker);
}
void writer(void *n)
{
int num = *(int *)n;
int i;
for (i = 0; i < 20; i++) {
uv_rwlock_wrlock(&numlock);
printf("Writer %d: acquired lock\n", num);
shared_num++;
printf("Writer %d: incremented shared num = %d\n", num, shared_num);
uv_rwlock_wrunlock(&numlock);
printf("Writer %d: released lock\n", num);
}
uv_barrier_wait(&blocker);
}
int main()
{
uv_barrier_init(&blocker, 4);
shared_num = 0;
uv_rwlock_init(&numlock);
uv_thread_t threads[3];
int thread_nums[] = {1, 2, 1};
uv_thread_create(&threads[0], reader, &thread_nums[0]);
uv_thread_create(&threads[1], reader, &thread_nums[1]);
uv_thread_create(&threads[2], writer, &thread_nums[2]);
uv_barrier_wait(&blocker);
uv_barrier_destroy(&blocker);
uv_rwlock_destroy(&numlock);
return 0;
}
Run this and literally just watch โ the readers will sometimes overlap ๐ like, yes bestie, that's the whole point. And when you've got multiple writers? Schedulers usually give them higher priority, so if you add two writers you'll see both writers tend to finish first before the readers get a chance again. Obsessed with the drama of it honestly.
We also use barriers in the example above so the main thread can wait for all readers and writers to indicate they have ended ๐ซถ (yes, the uv_barrier_wait(&blocker) in main โ that's the "are we all done" check-in, iconic behaviour).
๐ Others ๐
libuv also supports semaphores, condition variables and barriers โ with APIs very similar to their pthread counterparts. Here's where to read up if you want the lore:
- semaphores โ
https://en.wikipedia.org/wiki/Semaphore_(programming) - condition variables โ
https://en.wikipedia.org/wiki/Monitor_(synchronization)#Condition_variables_2 - barriers โ
https://en.wikipedia.org/wiki/Barrier_(computer_science)
In addition, libuv provides a convenience function uv_once(). Multiple threads can attempt to call uv_once() with a given guard and a function pointer โ only the first one will win, and the function gets called once and only once. No cap, one singular time:
/* Initialize guard */
static uv_once_t once_only = UV_ONCE_INIT;
int i = 0;
void increment() {
i++;
}
void thread1() {
/* ... work */
uv_once(once_only, increment);
}
void thread2() {
/* ... work */
uv_once(once_only, increment);
}
int main() {
/* ... spawn threads */
}
After all threads are done, i == 1. That's it. That's the whole flex โจ
libuv v0.11.11 onwards also added a uv_key_t struct and api for thread-local storage โ https://docs.libuv.org/en/v1.x/threading.html#thread-local-storage ๐
๐ธ libuv work queue ๐ธ
uv_queue_work() is a convenience function that lets an application run a task in a separate thread, and have a callback triggered when the task is done. Sounds simple, right? What makes uv_queue_work() so tempting is that it allows potentially any third-party libraries to be used with the event-loop paradigm. Because bestie โ when you use event loops, it is imperative to make sure that no function which runs periodically in the loop thread blocks when performing I/O or is a serious CPU hog. Why? Because that means the loop slows down and events are not being handled at full capacity ๐ญ
However, a lot of existing code out there features blocking functions (for example a routine which performs I/O under the hood) to be used with threads if you want responsiveness โ the classic 'one thread per client' server model โ and getting them to play with an event loop library generally involves rolling your own system of running the task in a separate thread. libuv just provides a convenient abstraction for this. King behaviour, honestly ๐
Here's a simple example inspired by node.js is cancer โ http://widgetsandshit.com/teddziuba/2011/10/node-js-is-cancer.html. We're going to calculate fibonacci numbers, sleeping a bit along the way, but run it in a separate thread so that the blocking and CPU bound task does not prevent the event loop from performing other activities.
queue-work/main.c โ lazy fibonacci:
void fib(uv_work_t *req) {
int n = *(int *) req->data;
if (random() % 2)
sleep(1);
else
sleep(3);
long fib = fib_(n);
fprintf(stderr, "%dth fibonacci is %lu\n", n, fib);
}
void after_fib(uv_work_t *req, int status) {
fprintf(stderr, "Done calculating %dth fibonacci\n", *(int *) req->data);
}
The actual task function is simple โ nothing to show that it's going to be run in a separate thread. The uv_work_t structure is the clue ๐ You can pass arbitrary data through it using the void* data field and use it to communicate to and from the thread. But be sure you are using proper locks if you're changing things while both threads may be running. Do not skip that part, I'm begging ๐
The trigger is uv_queue_work:
queue-work/main.c:
int main() {
loop = uv_default_loop();
int data[FIB_UNTIL];
uv_work_t req[FIB_UNTIL];
int i;
for (i = 0; i < FIB_UNTIL; i++) {
data[i] = i;
req[i].data = (void *) &data[i];
uv_queue_work(loop, &req[i], fib, after_fib);
}
return uv_run(loop, UV_RUN_DEFAULT);
}
The thread function will be launched in a separate thread, passed the uv_work_t structure, and once the function returns, the after function will be called on the thread the event loop is running in. It'll be passed the same structure. Symmetry, we love to see it ๐
For writing wrappers to blocking libraries, a common pattern #baton is to use a baton to exchange data.
Since libuv version 0.9.4 an additional function, uv_cancel(), is available. This allows you to cancel tasks on the libuv work queue. Only tasks that are yet to be started can be cancelled. If a task has already started executing, or it has finished executing, uv_cancel() will fail. Read that again, bestie โ it's not a magic undo button ๐ฅ
uv_cancel() is useful to cleanup pending tasks if the user requests termination. For example, a music player may queue up multiple directories to be scanned for audio files. If the user terminates the program, it should quit quickly and not wait until all pending requests are run. Nobody's got time for that.
Let's modify the fibonacci example to demonstrate uv_cancel(). We first set up a signal handler for termination.
queue-cancel/main.c:
int main() {
loop = uv_default_loop();
int data[FIB_UNTIL];
int i;
for (i = 0; i < FIB_UNTIL; i++) {
data[i] = i;
fib_reqs[i].data = (void *) &data[i];
uv_queue_work(loop, &fib_reqs[i], fib, after_fib);
}
uv_signal_t sig;
uv_signal_init(loop, &sig);
uv_signal_start(&sig, signal_handler, SIGINT);
return uv_run(loop, UV_RUN_DEFAULT);
}
When the user triggers the signal by pressing Ctrl+C we send uv_cancel() to all the workers. uv_cancel() will return 0 for those tasks that are pending execution and could be cancelled โจ
queue-cancel/main.c:
void signal_handler(uv_signal_t *req, int signum)
{
printf("Signal received!\n");
int i;
for (i = 0; i < FIB_UNTIL; i++) {
uv_cancel((uv_req_t*) &fib_reqs[i]);
}
uv_signal_stop(req);
}
For tasks that do get cancelled successfully, the after function is called with status set to UV_ECANCELED. Sad but correct ๐ญ
queue-cancel/main.c:
void after_fib(uv_work_t *req, int status) {
if (status == UV_ECANCELED)
fprintf(stderr, "Calculation of %d cancelled.\n", *(int *) req->data);
}
uv_cancel() can also be used with uv_fs_t and uv_getaddrinfo_t requests. For the filesystem family of functions, uv_fs_t.errorno will be set to UV_ECANCELED.
Tip: a well designed program would have a way to terminate long running workers that have already started executing. Such a worker could periodically check for a variable that only the main process sets to signal termination. Big brain move tbh ๐ง โจ
๐ฆ Inter-thread communication ๐ฆ
Sometimes you want various threads to actually send each other messages while they're running. For example you might be running some long duration task in a separate thread (perhaps using uv_queue_work) but want to notify progress to the main thread. This is a simple example of having a download manager informing the user of the status of running downloads ๐
progress/main.c โ the original listing is split up across the page, so here it is exactly as it appears:
uv_loop_t *loop;
}
void print_progress(uv_async_t *handle) {
double pct = atomic_load_explicit(&percentage, memory_order_acquire);
fprintf(stderr, "Downloaded %.2f%%\n", pct);
}
int main() {
loop = uv_default_loop();
uv_work_t req;
int size = 10240;
req.data = (void*) &size;
uv_async_init(loop, &async, print_progress);
uv_queue_work(loop, &req, fake_download, after);
return uv_run(loop, UV_RUN_DEFAULT);
}
The async thread communication works on loops, so although any thread can be the message sender, only threads with libuv loops can be receivers (or rather the loop is the receiver). libuv will invoke the callback (print_progress) with the async watcher whenever it receives a message ๐
Warning: it is important to realize that since the message send is async, the callback may be invoked immediately afteruv_async_sendis called in another thread, or it may be invoked after some time. libuv may also combine multiple calls touv_async_sendand invoke your callback only once. The only guarantee that libuv makes is: the callback function is called at least once after the call touv_async_send. If you have no pending calls touv_async_send, the callback won't be called. If you make two or more calls, and libuv hasn't had a chance to run the callback yet, it may invoke your callback only once for the multiple invocations ofuv_async_send. Your callback will never be called twice for just one event. Periodt ๐
progress/main.c:
_Atomic double percentage;
void fake_download(uv_work_t *req) {
int size = *((int*) req->data);
int downloaded = 0;
double pct;
while (downloaded < size) {
pct = downloaded * 100.0 / size;
atomic_store_explicit(&percentage, pct, memory_order_release);
uv_async_send(&async);
sleep(1);
downloaded += (200+random())%1000; // can only download max 1000bytes/sec,
// but at least a 200;
In the download function, we modify the progress indicator and queue the message for delivery with uv_async_send. Remember: uv_async_send is also non-blocking and will return immediately ๐ฅ
progress/main.c:
void after(uv_work_t *req, int status) {
fprintf(stderr, "Download complete\n");
uv_close((uv_handle_t*) &async, NULL);
okay so that callback is literally the standard libuv pattern โ itโs doing the thing where it extracts the data from the watcher. And bestie, please remember to clean up the watcher at the end, itโs important ๐
progress/main.c
// Ensure final 100% progress update is sent
pct = 100.0;
atomic_store_explicit(&percentage, pct, memory_order_release);
uv_async_send(&async);
After this example โ which lowkey showed the abuse of the data field โ bnoordhuis (GitHub: https://github.com/bnoordhuis) pointed out that using the data field is not thread safe, and uv_async_send() is actually only meant to wake up the event loop. Use a mutex or rwlock to make sure accesses are performed in the right order.
Note: mutexes and rwlocks DO NOT work inside a signal handler, whereas uv_async_send does.
One use case where uv_async_send is required is when interoperating with libraries that require thread affinity for their functionality. For example in node.js, a v8 engine instance, contexts and its objects are bound to the thread that the v8 instance was started in. Interacting with v8 data structures from another thread can lead to undefined results. Now consider some node.js module which binds a third party library. It may go something like this:
- In node, the third party library is set up with a JavaScript callback to be invoked for more information:
var lib = require('lib');
lib.on_progress(function() {
console.log("Progress");
});
lib.do();
// do other stuff
lib.dois supposed to be non-blocking but the third party lib is blocking, so the binding usesuv_queue_work.- The actual work being done in a separate thread wants to invoke the progress callback, but cannot directly call into v8 to interact with JavaScript. So it uses
uv_async_send. - The async callback, invoked in the main loop thread, which is the v8 thread, then interacts with v8 to invoke the JavaScript callback.
๐ Processes ๐
libuv offers considerable child process management, abstracting the platform differences and allowing communication with the child process using streams or named pipes.
A common idiom in Unix is for every process to do one thing and do it well. In such a case, a process often uses multiple child processes to achieve tasks (similar to using pipes in shells). A multi-process model with messages may also be easier to reason about compared to one with threads and shared memory.
A common refrain against event-based programs is that they cannot take advantage of multiple cores in modern computers. In a multi-threaded program the kernel can perform scheduling and assign different threads to different cores, improving performance. But an event loop has only one thread. The workaround can be to launch multiple processes instead, with each process running an event loop, and each process getting assigned to a separate CPU core โจ
๐ผ Spawning child processes ๐ผ
The simplest case is when you simply want to launch a process and know when it exits. This is achieved using uv_spawn.
spawn/main.c
uv_loop_t *loop;
uv_process_t child_req;
uv_process_options_t options;
int main() {
loop = uv_default_loop();
char* args[3];
args[0] = "mkdir";
args[1] = "test-dir";
args[2] = NULL;
options.exit_cb = on_exit;
options.file = "mkdir";
options.args = args;
int r;
if ((r = uv_spawn(loop, &child_req, &options))) {
fprintf(stderr, "%s\n", uv_strerror(r));
return 1;
} else {
fprintf(stderr, "Launched process with ID %d\n", child_req.pid);
}
return uv_run(loop, UV_RUN_DEFAULT);
}
Note:optionsis implicitly initialized with zeros since it is a global variable. If you changeoptionsto a local variable, remember to initialize it to null out all unused fields:c uv_process_options_t options = {0};
The uv_process_t struct only acts as the handle, all options are set via uv_process_options_t. To simply launch a process, you need to set only the file and args fields. file is the program to execute. Since uv_spawn uses execvp(3) internally, there is no need to supply the full path. Finally as per underlying conventions, the arguments array has to be one larger than the number of arguments, with the last element being NULL.
After the call to uv_spawn, uv_process_t.pid will contain the process ID of the child process.
The exit callback will be invoked with the exit status and the type of signal which caused the exit.
Note that it is important not to call uv_close before the exit callback.
spawn/main.c
void on_exit(uv_process_t *req, int64_t exit_status, int term_signal) {
fprintf(stderr, "Process exited with status %" PRId64 ", signal %d\n", exit_status, term_signal);
uv_close((uv_handle_t*) req, NULL);
It is required to close the process watcher after the process exits.
๐ง Changing process parameters ๐ง
Before the child process is launched you can control the execution environment using fields in uv_process_options_t.
๐ Change execution directory ๐
Set uv_process_options_t.cwd to the corresponding directory.
๐ฑ Set environment variables ๐ฑ
uv_process_options_t.env is a null-terminated array of strings, each of the form VAR=VALUE used to set up the environment variables for the process. Set this to NULL to inherit the environment from the parent (this) process.
๐ฉ Option flags ๐ฉ
Setting uv_process_options_t.flags to a bitwise OR of the following flags, modifies the child process behaviour:
UV_PROCESS_SETUIDโ sets the childโs execution user ID touv_process_options_t.uid.UV_PROCESS_SETGIDโ sets the childโs execution group ID touv_process_options_t.gid.
Changing the UID/GID is only supported on Unix, uv_spawn will fail on Windows with UV_ENOTSUP.
UV_PROCESS_WINDOWS_VERBATIM_ARGUMENTSโ No quoting or escaping ofuv_process_options_t.argsis done on Windows. Ignored on Unix.UV_PROCESS_DETACHEDโ Starts the child process in a new session, which will keep running after the parent process exits. See example below.
๐งจ Detaching processes ๐งจ
Passing the flag UV_PROCESS_DETACHED can be used to launch daemons, or child processes which are independent of the parent so that the parent exiting does not affect it.
detach/main.c
int main() {
loop = uv_default_loop();
char* args[3];
args[0] = "sleep";
args[1] = "100";
args[2] = NULL;
options.exit_cb = NULL;
options.file = "sleep";
options.args = args;
options.flags = UV_PROCESS_DETACHED;
int r;
if ((r = uv_spawn(loop, &child_req, &options))) {
fprintf(stderr, "%s\n", uv_strerror(r));
return 1;
}
fprintf(stderr, "Launched sleep with PID %d\n", child_req.pid);
uv_unref((uv_handle_t*) &child_req);
return uv_run(loop, UV_RUN_DEFAULT);
Just remember that the handle is still monitoring the child, so your program wonโt exit. Use uv_unref() if you want to be more fire-and-forget ๐ฅ
๐ก Sending signals to processes ๐ก
libuv wraps the standard kill(2) system call on Unix and implements one with similar semantics on Windows, with one caveat: all of SIGTERM, SIGINT and SIGKILL, lead to termination of the process. The signature of uv_kill is:
uv_err_t uv_kill(int pid, int signum);
For processes started using libuv, you may use uv_process_kill instead, which accepts the uv_process_t watcher as the first argument, rather than the pid. In this case, remember to call uv_close on the watcher after the exit callback has been called.
๐จ Signals ๐จ
libuv provides wrappers around Unix signals with some Windows support (https://docs.libuv.org/en/v1.x/signal.html#signal) as well.
Use uv_signal_init() to initialize a handle and associate it with a loop. To listen for particular signals on that handler, use uv_signal_start() with the handler function. Each handler can only be associated with one signal number, with subsequent calls to uv_signal_start() overwriting earlier associations. Use uv_signal_stop() to stop watching. Here is a small example demonstrating the various possibilities:
signal/main.c
#include <stdio.h>
#include <stdlib.h>
#include <unistd.h>
#include <uv.h>
uv_loop_t* create_loop()
{
uv_loop_t *loop = malloc(sizeof(uv_loop_t));
if (loop) {
uv_loop_init(loop);
}
return loop;
}
void signal_handler(uv_signal_t *handle, int signum)
{
printf("Signal received: %d\n", signum);
uv_signal_stop(handle);
}
// two signal handlers in one loop
void thread1_worker(void *userp)
{
uv_loop_t *loop1 = create_loop();
uv_signal_t sig1a, sig1b;
uv_signal_init(loop1, &sig1a);
uv_signal_start(&sig1a, signal_handler, SIGUSR1);
uv_signal_init(loop1, &sig1b);
uv_signal_start(&sig1b, signal_handler, SIGUSR1);
uv_run(loop1, UV_RUN_DEFAULT);
}
// two signal handlers, each in its own loop
void thread2_worker(void *userp)
{
uv_loop_t *loop2 = create_loop();
uv_loop_t *loop3 = create_loop();
uv_signal_t sig2;
uv_signal_init(loop2, &sig2);
uv_signal_start(&sig2, signal_handler, SIGUSR1);
uv_signal_t sig3;
uv_signal_init(loop3, &sig3);
uv_signal_start(&sig3, signal_handler, SIGUSR1);
while (uv_run(loop2, UV_RUN_NOWAIT) || uv_run(loop3, UV_RUN_NOWAIT)) {
}
}
int main()
{
printf("PID %d\n", getpid());
uv_thread_t thread1, thread2;
uv_thread_create(&thread1, thread1_worker, 0);
uv_thread_create(&thread2, thread2_worker, 0);
uv_thread_join(&thread1);
uv_thread_join(&thread2);
return 0;
}
Note:uv_run(loop, UV_RUN_NOWAIT)is similar touv_run(loop, UV_RUN_ONCE)in that it will process only one event.UV_RUN_ONCEblocks if there are no pending events, whileUV_RUN_NOWAITwill return immediately. We useNOWAITso that one of the loops isnโt starved because the other one has no pending activity.
...so you send SIGUSR1 to the process, and bestie, your handler gets invoked 4 times โ one for each uv_signal_t. The handler here just stops each handle so the program exits. This whole dispatch-to-all-handlers thing is lowkey gorgeous and super useful. Picture a server running multiple event loops that needs to make sure all data is safely saved before termination โ every loop just adds a watcher for SIGINT and you're done. Iconic. ๐
๐งธ Child Process I/O
okay so a normal, newly spawned process has its own set of file descriptors, with 0, 1 and 2 being stdin, stdout and stderr respectively. But sometimes you want to share file descriptors with the child. Like, say your app launches a sub-command and you want any errors to go in the log file, but you want to ignore stdout. For that you'd want the child's stderr to be the same as the parent's stderr. And yes โ libuv supports inheriting file descriptors, slay โจ
In this sample we invoke the test program, which is:
proc-streams/test.c
#include <stdio.h>
int main()
{
fprintf(stderr, "This is stderr\n");
printf("This is stdout\n");
return 0;
}
The actual program proc-streams runs this while sharing only stderr. The file descriptors of the child process get set using the stdio field in uv_process_options_t. First set the stdio_count field to the number of file descriptors being set. uv_process_options_t.stdio is an array of uv_stdio_container_t, which is:
typedef struct uv_stdio_container_s {
uv_stdio_flags flags;
union {
uv_stream_t* stream;
int fd;
} data;
} uv_stdio_container_t;
where flags can have several values. Use UV_IGNORE if it isn't going to be used. And heads up โ if the first three stdio fields are marked as UV_IGNORE they'll redirect to /dev/null. ๐ซถ
Since we want to pass on an existing descriptor, we'll use UV_INHERIT_FD. Then we set the fd to stderr.
proc-streams/main.c
int main() {
loop = uv_default_loop();
/* ... */
options.stdio_count = 3;
uv_stdio_container_t child_stdio[3];
child_stdio[0].flags = UV_IGNORE;
child_stdio[1].flags = UV_IGNORE;
child_stdio[2].flags = UV_INHERIT_FD;
child_stdio[2].data.fd = 2;
options.stdio = child_stdio;
options.exit_cb = on_exit;
options.file = args[0];
options.args = args;
int r;
if ((r = uv_spawn(loop, &child_req, &options))) {
fprintf(stderr, "%s\n", uv_strerror(r));
return 1;
}
return uv_run(loop, UV_RUN_DEFAULT);
}
If you run proc-stream you'll see that only the line "This is stderr" gets displayed. Try marking stdout as being inherited and see what the output does ๐
It is dead simple to apply this redirection to streams. By setting flags to UV_INHERIT_STREAM and setting data.stream to the stream in the parent process, the child process can treat that stream as standard I/O. This is literally how you'd implement something like CGI. ๐ฆ
A sample CGI script/executable is:
cgi/tick.c
#include <stdio.h>
#include <unistd.h>
int main() {
int i;
for (i = 0; i < 10; i++) {
printf("tick\n");
fflush(stdout);
sleep(1);
}
printf("BOOM!\n");
return 0;
}
The CGI server combines the concepts from this chapter and Networking so that every client gets sent ten ticks, after which that connection is closed. ๐
cgi/main.c
void on_new_connection(uv_stream_t *server, int status) {
if (status == -1) {
// error!
return;
}
uv_tcp_t *client = (uv_tcp_t*) malloc(sizeof(uv_tcp_t));
uv_tcp_init(loop, client);
if (uv_accept(server, (uv_stream_t*) client) == 0) {
invoke_cgi_script(client);
}
else {
uv_close((uv_handle_t*) client, NULL);
}
Here we simply accept the TCP connection and pass on the socket (stream) to invoke_cgi_script.
cgi/main.c
args[1] = NULL;
/* ... finding the executable path and setting up arguments ... */
options.stdio_count = 3;
uv_stdio_container_t child_stdio[3];
child_stdio[0].flags = UV_IGNORE;
child_stdio[1].flags = UV_INHERIT_STREAM;
child_stdio[1].data.stream = (uv_stream_t*) client;
child_stdio[2].flags = UV_IGNORE;
options.stdio = child_stdio;
options.exit_cb = cleanup_handles;
options.file = args[0];
options.args = args;
// Set this so we can close the socket after the child process exits.
child_req.data = (void*) client;
int r;
if ((r = uv_spawn(loop, &child_req, &options))) {
fprintf(stderr, "%s\n", uv_strerror(r));
The stdout of the CGI script is set to the socket so that whatever our tick script prints gets sent straight to the client. By using processes we can offload the read/write buffering to the operating system, so in terms of convenience this is great ๐ โ just be warned that creating processes is a costly task. ๐ญ
๐ Parent-child IPC
A parent and child can have one or two way communication over a pipe created by setting uv_stdio_container_t.flags to a bit-wise combination of UV_CREATE_PIPE and UV_READABLE_PIPE or UV_WRITABLE_PIPE. The read/write flag is from the perspective of the child process. In this case, the uv_stream_t* stream field must be set to point to an initialized, unopened uv_pipe_t instance. ๐
๐ New stdio Pipes
The uv_pipe_t structure represents more than just pipe(7) (or |), because it supports any streaming file-like objects. On Windows, the only object of that description is the Named Pipe. On Unix, this could be any of a Unix Domain Socket, or something derived from mkfifo(1), or it could actually be a pipe(7). When uv_spawn initializes a uv_pipe_t due to the UV_CREATE_PIPE flag, it opts for creating a socketpair(2). ๐
This is intended for the purpose of allowing multiple libuv processes to communicate with IPC. Which is discussed below. ๐
๐ Arbitrary process IPC
Since domain sockets [1] can have a well known name and a location in the file-system, they can be used for IPC between unrelated processes. The D-BUS system used by open source desktop environments uses domain sockets for event notification โ various applications can then react when a contact comes online or new hardware is detected. The MySQL server also runs a domain socket on which clients can interact with it. โจ
When using domain sockets, a client-server pattern is usually followed with the creator/owner of the socket acting as the server. After the initial setup, messaging is no different from TCP, so we'll re-use the echo server example. ๐
pipe-echo-server/main.c
void remove_sock(int sig) {
uv_fs_t req;
uv_fs_unlink(loop, &req, PIPENAME, NULL);
exit(0);
}
int main() {
loop = uv_default_loop();
uv_pipe_t server;
uv_pipe_init(loop, &server, 0);
signal(SIGINT, remove_sock);
int r;
if ((r = uv_pipe_bind(&server, PIPENAME))) {
fprintf(stderr, "Bind error %s\n", uv_err_name(r));
return 1;
}
if ((r = uv_listen((uv_stream_t*) &server, 128, on_new_connection))) {
fprintf(stderr, "Listen error %s\n", uv_err_name(r));
return 2;
}
return uv_run(loop, UV_RUN_DEFAULT);
}
We name the socket echo.sock which means it will be created in the local directory. This socket now behaves no different from TCP sockets as far as the stream API is concerned. You can test this server using socat:
$ socat - /path/to/socket
A client which wants to connect to a domain socket will use:
void uv_pipe_connect(uv_connect_t *req, uv_pipe_t *handle, const char *name, uv_connect_cb cb);
where name will be echo.sock or similar. On Unix systems, name must point to a valid file (e.g. /tmp/echo.sock). On Windows, name follows a \\?\pipe\echo.sock format. ๐ช
๐ Sending file descriptors over pipes
The cool thing about domain sockets is that file descriptors can be exchanged between processes by sending them over a domain socket. This allows processes to hand off their I/O to other processes โ applications include load-balancing servers, worker processes and other ways to make optimum use of CPU. libuv only supports sending TCP sockets or other pipes over pipes for now. ngl that's still pretty iconic. ๐
To demonstrate, we will look at an echo server implementation that hands off clients to worker processes in a round-robin fashion. This program is a bit involved, and while only snippets are included in the book, it is recommended to read the full code to really understand it. fr fr, go read it ๐
The worker process is quite simple, since the file-descriptor is handed over to it by the master.
multi-echo-server/worker.c
uv_loop_t *loop;
uv_pipe_t queue;
int main() {
loop = uv_default_loop();
uv_pipe_init(loop, &queue, 1 /* ipc */);
uv_pipe_open(&queue, 0);
uv_read_start((uv_stream_t*)&queue, alloc_buffer, on_new_connection);
return uv_run(loop, UV_RUN_DEFAULT);
}
queue is the pipe connected to the master process on the other end, along which new file descriptors get sent. It is important to set the ipc argument of uv_pipe_init to 1 to indicate this pipe will be used for inter-process communication! Since the master will write the file handle to the standard input of the worker, we connect the pipe to stdin using uv_pipe_open. ๐
multi-echo-server/worker.c
void on_new_connection(uv_stream_t *q, ssize_t nread, const uv_buf_t *buf) {
if (nread < 0) {
if (nread != UV_EOF)
fprintf(stderr, "Read error %s\n", uv_err_name(nread));
uv_close((uv_handle_t*) q, NULL);
return;
}
uv_pipe_t *pipe = (uv_pipe_t*) q;
if (!uv_pipe_pending_count(pipe)) {
fprintf(stderr, "No pending count\n");
return;
}
uv_handle_type pending = uv_pipe_pending_type(pipe);
assert(pending == UV_TCP);
...and the snippet cuts off right there ๐ซ โ hang tight, bestie, there's more coming ๐
uv_tcp_t *client = (uv_tcp_t*) malloc(sizeof(uv_tcp_t));
uv_tcp_init(loop, client);
if (uv_accept(q, (uv_stream_t*) client) == 0) {
uv_os_fd_t fd;
uv_fileno((const uv_handle_t*) client, &fd);
fprintf(stderr, "Worker %d: Accepted fd %d\n", getpid(), fd);
uv_read_start((uv_stream_t*) client, alloc_buffer, echo_read);
}
else {
uv_close((uv_handle_t*) client, NULL);
}
}
Okay so first things first: we hit up uv_pipe_pending_count() to make sure there's actually a handle sitting there ready to be read out, bestie. Because if there isn't, you're just grabbing at air ๐. And if your program is the kind that could deal with different types of handles, uv_pipe_pending_type() tells you which type you're working with. iykyk.
Now, the accept in there might look weird โ like, why are we accepting?? โ but it genuinely makes sense, no cap. What accept traditionally does is get a file descriptor (the client) from another file descriptor (the listening socket). Which is exactly what we're doing here. We fetch the file descriptor (client) from the queue. From that point on the worker is just doing standard echo server stuff. Iconic. ๐
Turning now to the master โ let's peek at how the workers get launched so we can do load balancing. main character energy only.
multi-echo-server/main.c
struct child_worker {
uv_process_t req;
uv_process_options_t options;
uv_pipe_t pipe;
} *workers;
The child_worker structure wraps the process, and the pipe between the master and the individual process. Cute little bundle, honestly ๐
multi-echo-server/main.c
void setup_workers() {
round_robin_counter = 0;
// ...
// launch same number of workers as number of CPUs
uv_cpu_info_t *info;
int cpu_count;
uv_cpu_info(&info, &cpu_count);
uv_free_cpu_info(info, cpu_count);
child_worker_count = cpu_count;
workers = calloc(cpu_count, sizeof(struct child_worker));
while (cpu_count--) {
struct child_worker *worker = &workers[cpu_count];
uv_pipe_init(loop, &worker->pipe, 1);
uv_stdio_container_t child_stdio[3];
child_stdio[0].flags = UV_CREATE_PIPE | UV_READABLE_PIPE;
child_stdio[0].data.stream = (uv_stream_t*) &worker->pipe;
child_stdio[1].flags = UV_IGNORE;
child_stdio[2].flags = UV_INHERIT_FD;
child_stdio[2].data.fd = 2;
worker->options.stdio = child_stdio;
worker->options.stdio_count = 3;
worker->options.exit_cb = close_process_handle;
worker->options.file = args[0];
worker->options.args = args;
uv_spawn(loop, &worker->req, &worker->options);
fprintf(stderr, "Started worker %d\n", worker->req.pid);
}
}
So in setting up the workers we use the nifty little libuv function uv_cpu_info to grab the number of CPUs, so we can launch an equal number of workers. Balance those loads, slay ๐ธ
And again โ it is genuinely important to initialize the pipe that's acting as our IPC channel with that third argument as 1. Do not skip it, fr. Then we indicate that the child process' stdin is going to be a readable pipe (readable from the point of view of the child, just to be clear). Everything is straightforward till here. The workers are launched and they're just sitting there waiting for file descriptors to be written to their standard input ๐ฆ
Then it's in on_new_connection (the TCP infrastructure is initialized in main()) that we accept the client socket and pass it along to the next worker in the round-robin. Chef's kiss scheduling.
multi-echo-server/main.c
void on_new_connection(uv_stream_t *server, int status) {
if (status == -1) {
// error!
return;
}
uv_tcp_t *client = (uv_tcp_t*) malloc(sizeof(uv_tcp_t));
uv_tcp_init(loop, client);
if (uv_accept(server, (uv_stream_t*) client) == 0) {
uv_write_t *write_req = (uv_write_t*) malloc(sizeof(uv_write_t));
dummy_buf = uv_buf_init("a", 1);
struct child_worker *worker = &workers[round_robin_counter];
uv_write2(write_req, (uv_stream_t*) &worker->pipe, &dummy_buf, 1, (uv_stream_t*) client, NULL);
round_robin_counter = (round_robin_counter + 1) % child_worker_count;
}
else {
uv_close((uv_handle_t*) client, NULL);
}
}
The uv_write2 call handles all the abstraction for us โ it is literally just a matter of passing in the handle (client) as the right argument. And with that, our multi-process echo server is operational ๐ฅ
Thanks to Kyle for pointing out <https://github.com/nikhilm/uvbook/issues/56> that uv_write2() requires a non-empty buffer even when sending handles. So like... yeah, that's a real thing, note it down ๐
----
[1] In this section domain sockets stands in for named pipes on Windows as well.
โจ Advanced event loops โจ
libuv gives you a considerable amount of user control over event loops, and you can absolutely achieve interesting results by juggling multiple loops at once โ like, full juggling routine, no notes ๐คนโโ๏ธ
You can also embed libuv's event loop into another event loop based library. Picture a Qt based UI, with Qt's event loop driving a libuv backend that's out there doing intensive system level tasks. Two loops, one vibe. ๐
๐ Stopping an event loop
uv_stop() can be used to stop an event loop. But listen โ the earliest the loop will stop running is on the next iteration, possibly later. Which means events that are ready to be processed in this iteration of the loop will still get processed. So uv_stop() can't be used as a kill switch. Not me learning that the hard way ๐ญ
When uv_stop() is called, the loop won't block for i/o on this iteration. The semantics of these things can be a bit difficult to understand, so let's look at uv_run() where all the control flow occurs. Grab a snack, bestie ๐
src/unix/core.c - uv_run
uv_signal_t* sh;
/* Note: while the handle is in the UV_HANDLE_CLOSING state now, it's still
* possible for it to be active in the sense that uv__is_active() returns
* true.
*
* A good example is when the user calls uv_shutdown(), immediately followed
* by uv_close(). The handle is considered active at this point because the
* completion of the shutdown req is still pending.
*/
assert(handle->flags & UV_HANDLE_CLOSING);
assert(!(handle->flags & UV_HANDLE_CLOSED));
handle->flags |= UV_HANDLE_CLOSED;
switch (handle->type) {
case UV_PREPARE:
case UV_CHECK:
case UV_IDLE:
case UV_ASYNC:
case UV_TIMER:
case UV_PROCESS:
stop_flag is set by uv_stop(). Now โ all libuv callbacks are invoked within the event loop, which is exactly why invoking uv_stop() in them will still lead to this iteration of the loop occurring. First libuv updates timers, then runs pending timer, idle and prepare callbacks, and invokes any pending I/O callbacks. If you were to call uv_stop() in any of them, stop_flag would be set. That causes uv_backend_timeout() to return 0, which is why the loop does not block on I/O. If, on the other hand, you called uv_stop() in one of the check handlers, I/O has already finished and is not affected. Timing is everything, literally ๐
uv_stop() is useful to shut down a loop when a result has been computed or there's an error, without having to ensure that all handlers are stopped one by one. So convenient, honestly.
Here's a simple example that stops the loop and demonstrates how the current iteration of the loop still takes place ๐
uvstop/main.c
#include <stdio.h>
#include <uv.h>
int64_t counter = 0;
void idle_cb(uv_idle_t *handle) {
printf("Idle callback\n");
counter++;
if (counter >= 5) {
uv_stop(uv_default_loop());
printf("uv_stop() called\n");
}
}
void prep_cb(uv_prepare_t *handle) {
printf("Prep callback\n");
}
int main() {
uv_idle_t idler;
uv_prepare_t prep;
uv_idle_init(uv_default_loop(), &idler);
uv_idle_start(&idler, idle_cb);
uv_prepare_init(uv_default_loop(), &prep);
uv_prepare_start(&prep, prep_cb);
uv_run(uv_default_loop(), UV_RUN_DEFAULT);
return 0;
}
๐ Utilities ๐
This chapter catalogues tools and techniques which are useful for common tasks. The libev man page <http://pod.tst.eu/http://cvs.schmorp.de/libev/ev.pod#COMMON_OR_USEFUL_IDIOMS_OR_BOTH> already covers some patterns which can be adopted to libuv through simple API changes. It also covers parts of the libuv API that don't require entire chapters dedicated to them. Efficient! We love a two-for-one ๐ซถ
โฐ Timers
Timers invoke the callback after a certain time has elapsed since the timer was started. And libuv timers can also be set to invoke at regular intervals instead of just once. Recurring queen behaviour ๐
Simple use is to init a watcher and start it with a timeout, and optional repeat. Timers can be stopped at any time.
uv_timer_t timer_req;
uv_timer_init(loop, &timer_req);
uv_timer_start(&timer_req, callback, 5000, 2000);
That will start a repeating timer, which first starts 5 seconds (the timeout) after the execution of uv_timer_start, then repeats every 2 seconds (the repeat). Math is mathing โจ
Use:
uv_timer_stop(&timer_req);
to stop the timer. And this one can be used safely from within the callback as well, so no stress ๐
The repeat interval can be modified at any time with:
uv_timer_set_repeat(uv_timer_t *timer, int64_t repeat);
which will take effect when possible. And if this function is called from a timer callback, it means:
- If the timer was non-repeating, the timer has already been stopped. Use
uv_timer_startagain. - If the timer is repeating, the next timeout has already been scheduled, so the old repeat interval will be used once more before the timer switches to the new interval.
The utility function:
int uv_timer_again(uv_timer_t *)
applies only to repeating timers and is equivalent to stopping the timer and then starting it with both initial timeout and repeat set to the old repeat value. If the timer hasn't been started it fails (error code UV_EINVAL) and returns -1. Sad times, but at least it tells you ๐ญ
An actual timer example is in the reference count section. Coming up next, bestie โ
๐ Event loop reference count
The event loop only runs as long as there are active handles. That's the whole system, no cap. This works by having every handle increase the reference count of the event loop when it is started and decreasing the reference count when stopped. It's giving very tidy little ledger ๐
It's also possible to manually change the reference count of handles using:
void uv_ref(uv_handle_t*);
void uv_unref(uv_handle_t*);
These functions can be used to allow a loop to exit even when a watcher is active, or to use custom objects to keep the loop alive. So like โ you get to decide who's keeping this party going ๐
Okay so the latter can be used with interval timers โ like, say youโve got a garbage collector that runs every X seconds, or your network service sends a heartbeat to everyone periodically, but you do not want to have to stop those along all the clean exit paths or error scenarios. Or maybe you want the program to exit when all your other watchers are done. In that case, just unref the timer immediately after creation so that if itโs the only watcher running, uv_run will still exit. Slay.
This is also used in node.js where some libuv methods are being bubbled up to the JS API. A uv_handle_t (the superclass of all watchers) is created per JS object and can be ref/unrefed. Iconic.
ref-timer/main.c
uv_loop_t *loop;
uv_timer_t gc_req;
uv_timer_t fake_job_req;
int main() {
loop = uv_default_loop();
uv_timer_init(loop, &gc_req);
uv_unref((uv_handle_t*) &gc_req);
uv_timer_start(&gc_req, gc, 0, 2000);
// could actually be a TCP download or something
uv_timer_init(loop, &fake_job_req);
uv_timer_start(&fake_job_req, fake_job, 9000, 0);
return uv_run(loop, UV_RUN_DEFAULT);
}
We initialize the garbage collector timer, then immediately unref it. Observe how after 9 seconds, when the fake job is done, the program automatically exits, even though the garbage collector is still running. The vibe check passed ๐
๐ธ Idler pattern ๐ธ
The callbacks of idle handles are invoked once per event loop. The idle callback can be used to perform some very low priority activity. For example, you could dispatch a summary of the daily application performance to the developers for analysis during periods of idleness, or use the applicationโs CPU time to perform SETI calculations :) An idle watcher is also useful in a GUI application. Say you are using an event loop for a file download. If the TCP socket is still being established and no other events are present, your event loop will pause (block), which means your progress bar will freeze and the user will face an unresponsive application. In such a case, queue up an idle watcher to keep the UI operational. Main character energy for the event loop, honestly.
idle-compute/main.c
uv_loop_t *loop;
uv_fs_t stdin_watcher;
uv_idle_t idler;
char buffer[1024];
int main() {
loop = uv_default_loop();
uv_idle_init(loop, &idler);
uv_buf_t buf = uv_buf_init(buffer, 1024);
uv_fs_read(loop, &stdin_watcher, 0, &buf, 1, -1, on_type);
uv_idle_start(&idler, crunch_away);
return uv_run(loop, UV_RUN_DEFAULT);
}
Here we initialize the idle watcher and queue it up along with the actual events we are interested in. crunch_away will now be called repeatedly until the user types something and presses Return. Then it will be interrupted for a brief amount as the loop deals with the input data, after which it will keep calling the idle callback again. Itโs giving โmultitasking but make it cute.โ ๐ฆ
idle-compute/main.c
void crunch_away(uv_idle_t* handle) {
// Compute extra-terrestrial life
// fold proteins
// computer another digit of PI
// or similar
fprintf(stderr, "Computing PI...\n");
// just to avoid overwhelming your terminal emulator
uv_idle_stop(handle);
}
๐ซถ Passing data to worker thread ๐ซถ
When using uv_queue_work youโll usually need to pass complex data through to the worker thread. The solution is to use a struct and set uv_work_t.data to point to it. A slight variation is to have the uv_work_t itself as the first member of this struct (called a baton [1]). This allows cleaning up the work request and all the data in one free call. No cap, thatโs efficient.
struct ftp_baton {
uv_work_t req;
char *host;
int port;
char *username;
char *password;
}
ftp_baton *baton = (ftp_baton*) malloc(sizeof(ftp_baton));
baton->req.data = (void*) baton;
baton->host = strdup("my.webhost.com");
baton->port = 21;
// ...
uv_queue_work(loop, &baton->req, ftp_session, ftp_cleanup);
Here we create the baton and queue the task.
Now the task function can extract the data it needs:
void ftp_session(uv_work_t *req) {
ftp_baton *baton = (ftp_baton*) req->data;
fprintf(stderr, "Connecting to %s\n", baton->host);
}
void ftp_cleanup(uv_work_t *req) {
ftp_baton *baton = (ftp_baton*) req->data;
free(baton->host);
// ...
free(baton);
}
We then free the baton, which also frees the watcher. One little cleanup moment, zero chaos. ๐
๐ฅ External I/O with polling ๐ฅ
Usually third-party libraries will handle their own I/O, and keep track of their sockets and other files internally. In this case it isnโt possible to use the standard stream I/O operations, but the library can still be integrated into the libuv event loop. All that is required is that the library allow you to access the underlying file descriptors and provide functions that process tasks in small increments as decided by your application. Some libraries though will not allow such access, providing only a standard blocking function which will perform the entire I/O transaction and only then return. It is unwise to use these in the event loop thread โ use the Thread pool work scheduling #threadpool instead. Of course, this will also mean losing granular control on the library. Sad but true, bestie.
The uv_poll section of libuv simply watches file descriptors using the operating system notification mechanism. In some sense, all the I/O operations that libuv implements itself are also backed by uv_poll-like code. Whenever the OS notices a change of state in file descriptors being polled, libuv will invoke the associated callback.
Here we will walk through a simple download manager that will use libcurl (https://curl.se/libcurl/) to download files. Rather than give all control to libcurl, weโll instead be using the libuv event loop, and use the non-blocking, async multi (https://curl.se/libcurl/c/libcurl-multi.html) interface to progress with the download whenever libuv notifies of I/O readiness. Itโs giving teamwork, honestly.
uvwget/main.c โ The setup
#include <assert.h>
#include <stdio.h>
#include <stdlib.h>
#include <uv.h>
#include <curl/curl.h>
uv_loop_t *loop;
CURLM *curl_handle;
uv_timer_t timeout;
int main(int argc, char **argv) {
loop = uv_default_loop();
if (argc <= 1)
return 0;
if (curl_global_init(CURL_GLOBAL_ALL)) {
fprintf(stderr, "Could not init cURL\n");
return 1;
}
uv_timer_init(loop, &timeout);
curl_handle = curl_multi_init();
curl_multi_setopt(curl_handle, CURLMOPT_SOCKETFUNCTION, handle_socket);
curl_multi_setopt(curl_handle, CURLMOPT_TIMERFUNCTION, start_timeout);
while (argc-- > 1) {
add_download(argv[argc], argc);
}
uv_run(loop, UV_RUN_DEFAULT);
curl_multi_cleanup(curl_handle);
return 0;
}
The way each library is integrated with libuv will vary. In the case of libcurl, we can register two callbacks. The socket callback handle_socket is invoked whenever the state of a socket changes and we have to start polling it. start_timeout is called by libcurl to notify us of the next timeout interval, after which we should drive libcurl forward regardless of I/O status. This is so that libcurl can handle errors or do whatever else is required to get the download moving.
Our downloader is to be invoked as:
$ ./uvwget [url1] [url2] ...
So we add each argument as a URL
uvwget/main.c โ Adding urls
void add_download(const char *url, int num) {
char filename[50];
sprintf(filename, "%d.download", num);
FILE *file;
file = fopen(filename, "w");
if (file == NULL) {
fprintf(stderr, "Error opening %s\n", filename);
return;
}
CURL *handle = curl_easy_init();
curl_easy_setopt(handle, CURLOPT_WRITEDATA, file);
curl_easy_setopt(handle, CURLOPT_URL, url);
curl_multi_add_handle(curl_handle, handle);
fprintf(stderr, "Added download %s -> %s\n", url, filename);
}
We let libcurl directly write the data to a file, but much more is possible if you so desire.
start_timeout will be called immediately the first time by libcurl, so things are set in motion. This simply starts a libuv timer #timers which drives curl_multi_socket_action with CURL_SOCKET_TIMEOUT whenever it times out. curl_multi_socket_action is what drives libcurl, and what we call whenever sockets change state. But before we go into that, we need to poll on sockets whenever handle_socket is called. Bestie, this is the glue.
uvwget/main.c โ Setting up polling
void start_timeout(CURLM *multi, long timeout_ms, void *userp) {
if (timeout_ms <= 0)
timeout_ms = 1; /* 0 means directly call socket_action, but we'll do it in a bit */
uv_timer_start(&timeout, on_timeout, timeout_ms, 0);
}
int handle_socket(CURL *easy, curl_socket_t s, int action, void *userp, void *socketp) {
curl_context_t *curl_context;
if (action == CURL_POLL_IN || action == CURL_POLL_OUT) {
if (socketp) {
curl_context = (curl_context_t*) socketp;
}
else {
curl_context = create_curl_context(s);
curl_multi_assign(curl_handle, s, (void *) curl_context);
}
}
switch (action) {
case CURL_POLL_IN:
uv_poll_start(&curl_context->poll_handle, UV_READABLE, curl_perform);
break;
case CURL_POLL_OUT:
uv_poll_start(&curl_context->poll_handle, UV_WRITABLE, curl_perform);
break;
case CURL_POLL_REMOVE:
if (socketp) {
uv_poll_stop(&((curl_context_t*)socketp)->poll_handle);
destroy_curl_context((curl_context_t*) socketp);
curl_multi_assign(curl_handle, s, NULL);
}
break;
default:
abort();
}
return 0;
}
We are interested in the socket fd s, and the action. For every socket we create a uv_poll_t handle if it doesnโt exist, and associate it with the socket using curl_multi_assign. This way socketp points to it whenever the callback is invoked.
In the case that the download is done or fails, libcurl requests removal of the poll. So we stop and free the poll handle. Clean exit, no crumbs. โจ
Depending on what events libcurl wishes to watch for, we start polling with UV_READABLE or UV_WRITABLE. Thatโs the vibe. Now libuv will invoke the poll callback whenever the socket is ready for reading or writing. Calling uv_poll_start multiple times on the same handle is totally acceptable โ it will just update the events mask with the new value. curl_perform is the crux of this program.
uvwget/main.c โ Driving libcurl.
void curl_perform(uv_poll_t *req, int status, int events) {
uv_timer_stop(&timeout);
int running_handles;
int flags = 0;
if (status < 0) flags = CURL_CSELECT_ERR;
if (!status && events & UV_READABLE) flags |= CURL_CSELECT_IN;
if (!status && events & UV_WRITABLE) flags |= CURL_CSELECT_OUT;
curl_context_t *context;
context = (curl_context_t*)req;
curl_multi_socket_action(curl_handle, context->sockfd, flags, &running_handles);
check_multi_info();
}
The first thing we do is stop the timer, because thereโs been some progress in the interval. Then depending on what event triggered the callback, we set the correct flags. Then we call curl_multi_socket_action with the socket that progressed and the flags informing about what events happened. At this point libcurl does all of its internal tasks in small increments, and will attempt to return as fast as possible โ which is exactly what an evented program wants in its main thread. libcurl keeps queueing messages into its own queue about transfer progress. In our case we are only interested in transfers that are completed. So we extract these messages, and clean up handles whose transfers are done.
uvwget/main.c โ Reading transfer status.
void check_multi_info(void) {
char *done_url;
CURLMsg *message;
int pending;
while ((message = curl_multi_info_read(curl_handle, &pending))) {
switch (message->msg) {
case CURLMSG_DONE:
curl_easy_getinfo(message->easy_handle, CURLINFO_EFFECTIVE_URL,
&done_url);
printf("%s DONE\n", done_url);
curl_multi_remove_handle(curl_handle, message->easy_handle);
curl_easy_cleanup(message->easy_handle);
break;
default:
fprintf(stderr, "CURLMSG default\n");
abort();
}
}
}
Check & Prepare watchers ๐ญ
TODO ๐
Loading libraries ๐
libuv provides a cross platform API to dynamically load shared libraries โ the wiki link is https://en.wikipedia.org/wiki/Shared_library. This can be used to implement your own plugin/extension/module system and is used by node.js to implement require() support for bindings. The usage is quite simple as long as your library exports the right symbols. Be careful with sanity and security checks when loading third party code, otherwise your program will behave unpredictably. This example implements a very simple plugin system which does nothing except print the name of the plugin.
Let us first look at the interface provided to plugin authors.
plugin/plugin.h
#ifndef UVBOOK_PLUGIN_SYSTEM
#define UVBOOK_PLUGIN_SYSTEM
// Plugin authors should use this to register their plugins with mfp.
void mfp_register(const char *name);
#endif
You can similarly add more functions that plugin authors can use to do useful things in your application [2]. A sample plugin using this API is:
plugin/hello.c
#include "plugin.h"
void initialize() {
mfp_register("Hello World!");
}
Our interface defines that all plugins should have an initialize function which will be called by the application. This plugin is compiled as a shared library and can be loaded by running our application:
$ ./plugin libhello.dylib
Loading libhello.dylib
Registered plugin "Hello World!"
Note: The shared library filename will be different depending on platforms. On Linux it is libhello.so.
This is done by using uv_dlopen to first load the shared library libhello.dylib. Then we get access to the initialize function using uv_dlsym and invoke it.
plugin/main.c
#include "plugin.h"
typedef void (*init_plugin_function)();
void mfp_register(const char *name) {
fprintf(stderr, "Registered plugin \"%s\"\n", name);
}
int main(int argc, char **argv) {
if (argc == 1) {
fprintf(stderr, "Usage: %s [plugin1] [plugin2] ...\n", argv[0]);
return 0;
}
uv_lib_t lib;
while (--argc) {
fprintf(stderr, "Loading %s\n", argv[argc]);
if (uv_dlopen(argv[argc], &lib)) {
fprintf(stderr, "Error: %s\n", uv_dlerror(&lib));
continue;
}
init_plugin_function init_plugin;
if (uv_dlsym(&lib, "initialize", (void **) &init_plugin)) {
fprintf(stderr, "dlsym error: %s\n", uv_dlerror(&lib));
continue;
}
init_plugin();
}
return 0;
}
uv_dlopen expects a path to the shared library and sets the opaque uv_lib_t pointer. It returns 0 on success, -1 on error. Use uv_dlerror to get the error message.
uv_dlsym stores a pointer to the symbol in the second argument in the third argument. init_plugin_function is a function pointer to the sort of function we are looking for in the application's plugins.
TTY ๐ฅ๏ธ
Text terminals have supported basic formatting for a long time, with a pretty standardised https://en.wikipedia.org/wiki/ANSI_escape_sequences command set. This formatting is often used by programs to improve the readability of terminal output. For example grep --colour. libuv provides the uv_tty_t abstraction (a stream) and related functions to implement the ANSI escape codes across all platforms. By this I mean that libuv converts ANSI codes to the Windows equivalent, and provides functions to get terminal information.
The first thing to do is to initialize a uv_tty_t with the file descriptor it reads/writes from. This is achieved with:
int uv_tty_init(uv_loop_t*, uv_tty_t*, uv_file fd, int unused)
The unused parameter is now auto-detected and ignored. It previously needed to be set to use uv_read_start() on the stream.
It is then best to use uv_tty_set_mode to set the mode to normal which enables most TTY formatting, flow-control and other settings. Other https://docs.libuv.org/en/v1.x/tty.html#c.uv_tty_mode_t modes are also available.
Remember to call uv_tty_reset_mode when your program exits to restore the state of the terminal. Just good manners. Another set of good manners is to be aware of redirection. If the user redirects the output of your command to a file, control sequences should not be written as they impede readability and grep. To check if the file descriptor is indeed a TTY, call uv_guess_handle with the file descriptor and compare the return value with UV_TTY.
Here is a simple example which prints white text on a red background:
tty/main.c
#include <stdio.h>
#include <string.h>
#include <unistd.h>
#include <uv.h>
uv_loop_t *loop;
uv_tty_t tty;
int main() {
uv_write_t req;
uv_buf_t buf;
uv_write_t req1;
uv_buf_t buf1;
loop = uv_default_loop();
uv_tty_init(loop, &tty, STDOUT_FILENO, 0);
uv_tty_set_mode(&tty, UV_TTY_MODE_NORMAL);
if (uv_guess_handle(1) == UV_TTY) {
buf1.base = "\033[41;37m";
buf1.len = strlen(buf1.base);
uv_write(&req1, (uv_stream_t*) &tty, &buf1, 1, NULL);
}
buf.base = "Hello TTY\n";
buf.len = strlen(buf.base);
uv_write(&req, (uv_stream_t*) &tty, &buf, 1, NULL);
uv_tty_reset_mode();
return uv_run(loop, UV_RUN_DEFAULT);
}
The final TTY helper is uv_tty_get_winsize() which is used to get the width and height of the terminal and returns 0 on success. Here is a small program which does some animation using the function and character position escape codes.
tty-gravity/main.c
#include <stdio.h>
#include <string.h>
#include <unistd.h>
#include <uv.h>
uv_loop_t *loop;
uv_tty_t tty;
uv_timer_t tick;
uv_write_t write_req;
int width, height;
int pos = 0;
char *message = " Hello TTY ";
void update(uv_timer_t *req) {
char data[500];
uv_buf_t buf;
buf.base = data;
buf.len = sprintf(data, "\033[2J\033[H\033[%dB\033[%luC\033[42;37m%s",
pos,
(unsigned long) (width-strlen(message))/2,
message);
uv_write(&write_req, (uv_stream_t*) &tty, &buf, 1, NULL);
pos++;
if (pos > height) {
uv_tty_reset_mode();
uv_timer_stop(&tick);
}
}
int main() {
loop = uv_default_loop();
uv_tty_init(loop, &tty, STDOUT_FILENO, 0);
uv_tty_set_mode(&tty, 0);
if (uv_tty_get_winsize(&tty, &width, &height)) {
fprintf(stderr, "Could not get TTY information\n");
uv_tty_reset_mode();
return 1;
}
fprintf(stderr, "Width %d, height %d\n", width, height);
uv_timer_init(loop, &tick);
uv_timer_start(&tick, update, 200, 200);
return uv_run(loop, UV_RUN_DEFAULT);
}
The escape codes are:
2 Jโ clear part of the screen; the2means the entire screen bestie, full wipeHโ moves the cursor to a certain position, default is top-left (home sweet home)n Bโ moves the cursor down bynlinesn Cโ moves the cursor right byncolumnsmโ obeys a string of display settings; in this case green background (40+2), white text (30+7)
As you can see this is very useful to produce nicely formatted output, or even console based arcade games if that tickles your fancy. For fancier control you can try ncurses โ https://invisible-island.net/ncurses/announce.html ๐ฎโจ
Changed in version1.23.1: thereadableparameter is now unused and ignored. The appropriate value will now be auto-detected from the kernel. (so likeโฆ don't bother setting it, it's giving retired ๐)
[1] I was first introduced to the term baton in this context, in Konstantin Kรคfer's excellent slides on writing node.js bindings โ https://kkaefer.github.io/node-cpp-modules/#baton (video: https://youtu.be/GajiVsJwSkY?list=PL37ZVnwpeshEVYiRemhMII6ORJmsJuqP7&t=1009)
[2] mfp is My Fancy Plugin
๐ซถ About
Nikhil Marathe (https://nikhilism.com) started writing this book one afternoon (June 16, 2012) when he didn't feel like programming. Relatable king behavior honestly. He had recently been stung by the lack of good documentation on libuv while working on node-taglib (https://github.com/nikhilm/node-taglib). Like, reference documentation was present, but there were no comprehensive tutorials โ tragic. This book is the output of that need and tries to be accurate. That said, the book may have mistakes. Pull requests are encouraged. ๐ซถ
Nikhil is indebted to Marc Lehmann's comprehensive man page about libev โ http://pod.tst.eu/http://cvs.schmorp.de/libev/ev.pod โ which describes much of the semantics of the two libraries.
This book was made using Sphinx (https://www.sphinx-doc.org) and vim (https://www.vim.org). iconic tooling tbh ๐
Note: In 2017 the libuv project incorporated Nikhil's work into the official documentation and it's maintained there henceforth.
โฌ๏ธ Upgrading
Migration guides for different libuv versions, starting with 1.0.
๐ฆ libuv 0.10 -> 1.0.0 migration guide
Some APIs changed quite a bit throughout the 1.0.0 development process. Here is a migration guide for the most significant changes that happened after 0.10 was released. Buckle up bestie, we're going through the glow-up era ๐
๐ Loop initialization and closing
In libuv 0.10 (and previous versions), loops were created with uv_loop_new, which allocated memory for a new loop and initialized it; and destroyed with uv_loop_delete, which destroyed the loop and freed the memory. Starting with 1.0, those are deprecated and the user is responsible for allocating the memory and then initializing the loop. You're the main character now, you do the mallocing โจ
libuv 0.10
uv_loop_t* loop = uv_loop_new();
...
uv_loop_delete(loop);
libuv 1.0
uv_loop_t* loop = malloc(sizeof *loop);
uv_loop_init(loop);
...
uv_loop_close(loop);
free(loop);
Note: Error handling was omitted for brevity. Check the documentation foruv_loop_init()anduv_loop_close().
๐ Error handling
Error handling had a major overhaul in libuv 1.0. In general, functions and status parameters would get 0 for success and -1 for failure on libuv 0.10, and the user had to use uv_last_error to fetch the error code, which was a positive number.
In 1.0, functions and status parameters contain the actual error code, which is 0 for success, or a negative number in case of error. So much cleaner, no cap ๐
libuv 0.10
... assume 'server' is a TCP server which is already listening
r = uv_listen((uv_stream_t*) server, 511, NULL);
if (r == -1) {
uv_err_t err = uv_last_error(uv_default_loop());
/* err.code contains UV_EADDRINUSE */
}
libuv 1.0
... assume 'server' is a TCP server which is already listening
r = uv_listen((uv_stream_t*) server, 511, NULL);
if (r < 0) {
/* r contains UV_EADDRINUSE */
}
๐งต Threadpool changes
In libuv 0.10 Unix used a threadpool which defaulted to 4 threads, while Windows used the QueueUserWorkItem API, which uses a Windows internal threadpool, which defaults to 512 threads per process.
In 1.0, we unified both implementations, so Windows now uses the same implementation Unix does. The threadpool size can be set by exporting the UV_THREADPOOL_SIZE environment variable. See Thread pool work scheduling. ๐ซถ
๐ Allocation callback API change
In libuv 0.10 the callback had to return a filled uv_buf_t by value:
uv_buf_t alloc_cb(uv_handle_t* handle, size_t size) {
return uv_buf_init(malloc(size), size);
}
In libuv 1.0 a pointer to a buffer is passed to the callback, which the user needs to fill:
void alloc_cb(uv_handle_t* handle, size_t size, uv_buf_t* buf) {
buf->base = malloc(size);
buf->len = size;
}
๐ Unification of IPv4 / IPv6 APIs
libuv 1.0 unified the IPv4 and IPv6 APIS. There is no longer a uv_tcp_bind and uv_tcp_bind6 duality, there is only uv_tcp_bind() now. One function to rule them all ๐
IPv4 functions took struct sockaddr_in structures by value, and IPv6 functions took struct sockaddr_in6. Now functions take a struct sockaddr* (note it's a pointer). It can be stack allocated.
libuv 0.10
struct sockaddr_in addr = uv_ip4_addr("0.0.0.0", 1234);
...
uv_tcp_bind(&server, addr)
libuv 1.0
struct sockaddr_in addr;
uv_ip4_addr("0.0.0.0", 1234, &addr)
...
uv_tcp_bind(&server, (const struct sockaddr*) &addr, 0);
The IPv4 and IPv6 struct creating functions (uv_ip4_addr() and uv_ip6_addr()) have also changed, make sure you check the documentation. fr fr, don't skip it ๐
Note: This change applies to all functions that made a distinction between IPv4 and IPv6 addresses.
๐ก Streams / UDP data receive callback API change
The streams and UDP data receive callbacks now get a pointer to a uv_buf_t buffer, not a structure by value.
libuv 0.10
void on_read(uv_stream_t* handle,
ssize_t nread,
uv_buf_t buf) {
...
}
void recv_cb(uv_udp_t* handle,
ssize_t nread,
uv_buf_t buf,
struct sockaddr* addr,
unsigned flags) {
...
}
libuv 1.0
void on_read(uv_stream_t* handle,
ssize_t nread,
const uv_buf_t* buf) {
...
}
void recv_cb(uv_udp_t* handle,
ssize_t nread,
const uv_buf_t* buf,
const struct sockaddr* addr,
unsigned flags) {
...
}
๐ฐ Receiving handles over pipes API change
In libuv 0.10 (and earlier versions) the uv_read2_start function was used to start reading data on a pipe, which could also result in the reception of handles over it. The callback for such function looked like this:
void on_read(uv_pipe_t* pipe,
ssize_t nread,
uv_buf_t buf,
uv_handle_type pending) {
...
}
In libuv 1.0, uv_read2_start was removed, and the user needs to check if there are pending handles using uv_pipe_pending_count() and uv_pipe_pending_type() while in the read callback:
void on_read(uv_stream_t* handle,
ssize_t nread,
const uv_buf_t* buf) {
...
while (uv_pipe_pending_count((uv_pipe_t*) handle) != 0) {
pending = uv_pipe_pending_type((uv_pipe_t*) handle);
...
}
...
}
๐ Extracting the file descriptor out of a handle
While it wasn't supported by the API, users often accessed the libuv internals in order to get access to the file descriptor of a TCP handle, for example.
fd = handle->io_watcher.fd;
This is now properly exposed through the uv_fileno() function. No more sneaking around in the internals, we have a real door now ๐ชโจ
๐ uv_fs_readdir rename and API change
uv_fs_readdir returned a list of strings in the req->ptr field upon completion in libuv 0.10. In 1.0, this function got renamed to uv_fs_scandir(), since it's actually implemented using scandir(3).
In addition, instead of allocating a full list strings, the user is able to get one result at a time by using the uv_fs_scandir_next() function. This function does not need to make a roundtrip to the threadpool, because libuv will keep the list of dents returned by scandir(3) around. Efficient queen behavior ๐
๐ฅ DOWNLOADS
libuv can be downloaded from here โ https://dist.libuv.org/dist/ ๐
๐ง INSTALLATION
Installation instructions can be found in the README โ https://github.com/libuv/libuv/blob/master/README.md
๐ Author
libuv contributors
๐ธ Copyright
2014-present, libuv contributors
and that's the whole page bestie, you made it to the end ๐๐
before you close the tab: this lil slice of the manual is version 1.53.0, dated Sep 25, 2026 โ that's the LIBUV(1) energy you're running, k? now go write something iconic with it ๐ฆโจ
๐ฆ where this page comes from
- arch rolling: libuv 1.53.0-1 ยท MIT AND BSD-2-Clause AND ISC AND CC-BY-4.0
- ๐ girlified by deepseek-ai/DeepSeek-V4.1-Flash-1017 on : a language model's rewrite of the original, under its terms