parallel-rsync(1)
π parallel-rsync π
okay bestie, welcome to parallel-rsync β that's the one from the General Commands Manual section of your man pages, and it's literally the moment your file-copying life gets a glow-up. β¨
πΈ NAME πΈ
parallel-rsync β parallel file sync program π¦
β¨ SYNOPSIS β¨
parallel-rsync [-vAraz] [-h hosts_file] [-H [user@]host[:port]] [-l user] [-p par] [-o outdir] [-e errdir] [-t timeout] [-O options] [-x args] [-X arg] [-S args] local ... remote
π DESCRIPTION π
so parallel-rsync is a program for copying files in parallel to a whole bunch of hosts, and it does it using the iconic, beloved rsync program. no cap, she's serving.
she comes with features like passing a password to ssh, saving output to files, and timing out. like, she's got range. π
π OPTIONS π
-hhost_file,--hostshost_file β read hosts from the given host_file. the lines in that host file look like[user@]host[:port]and, slay, they can also include blank lines and comments (lines starting with#). if you give her multiple host files (yes, by using-hmore than once), thenparallel-rsyncbehaves as though those files were concatenated together. and if a host shows up multiple times? she will connect the given number of times. periodt.-H[user@]host[:port]--host[user@]host[:port]-H"[user@]host[:port] [ [user@]host[:port ] ... ]"--host"[user@]host[:port] [ [user@]host[:port ] ... ]"β add those host strings to the list of hosts. this option may be given multiple times, and she plays nicely with the-hoption too, so you can mix and match. π«Ά-luser,--useruser β use the given username as the default for any host entries that don't specifically specify a user. it's giving fallback queen.-pparallelism,--parparallelism β use the given number as the maximum number of concurrent connections. yes, you're the one controlling the chaos. π-ttimeout,--timeouttimeout β make connections time out after the given number of seconds. with a value of0,parallel-rsyncwill not timeout any connections β she'll wait forever, iconic but also π.-ooutdir,--outdiroutdir β save standard output to files in the given directory. filenames are of the form[user@]host[:port][.num], where the user and port are only included for hosts that explicitly specify them. the number is a counter that gets incremented each time for hosts that are specified more than once.-eerrdir,--errdirerrdir β save standard error to files in the given directory. filenames are of the same form as with the-ooption. matching set, adorable.-xargs,--extra-argsargs β passes extrarsynccommand-line arguments (peep thersync(1)man page for more info about rsync arguments). this option may be specified multiple times. the arguments are processed to split on whitespace, protect text within quotes, and escape with backslashes. to pass arguments without such processing, use the-Xoption instead.-Xarg,--extra-argarg β passes a singlersynccommand-line argument (again,rsync(1)has the lore). unlike the-xoption, no processing is performed on the argument, including word splitting. to pass multiple command-line arguments, use the option once for each argument. one at a time, bestie.-Ooptions,--optionsoptions β SSH options in the format used in the SSH configuration file (checkssh_config(5)for more info). this option may be specified multiple times.-A,--askpassβ prompt for a password and pass it tossh. the password may be used for either unlocking a key or for password authentication. the password is transferred in a fairly secure manner (e.g., it will not show up in argument lists).
but be aware that a root user on your system could potentially intercept the password. π not to be dramatic but that's a real caveat, keep it in mind.
-v,--verboseβ include error messages fromrsyncwith the-iand-eoptions.-r,--recursiveβ recursively copy directories. go deeper. π-a,--archiveβ usersyncarchive mode (that's rsync's-aoption).-z,--compressβ usersynccompression.-Sargs,--ssh-argsargs β passes extra SSH command-line arguments (see thessh(1)man page for more info about SSH arguments). the given value is appended to thesshcommand (that's rsync's-eoption) without any processing. raw. unprocessed. main character energy.
π TIPS π
the ssh_config file can include an arbitrary number of Host sections. each host entry specifies ssh options which apply only to the given host. host definitions can even behave like aliases if the HostName option is included. this ssh feature, in combination with parallel-ssh host files, provides a tremendous amount of flexibility. like, the range? unmatched. π
β EXIT STATUS β
the exit status codes from parallel-rsync are as follows:
0β Success β¨1β Miscellaneous error2β Syntax or usage error3β At least one process was killed by a signal or timed out.4β All processes completed, but at least one rsync process reported an error (exit status other than0).
π AUTHORS π
written by Brent N. Chun <bnc@theether.org> and Andrew McNabb <amcnabb@mcnabbs.org>. legends fr fr.
https://github.com/lilydjwg/parallel-ssh
π§ SEE ALSO π§
rsync(1), ssh(1), ssh_config(5), parallel-ssh(1), parallel-rsync(1), parallel-slurp(1), parallel-nuke(1),
and that's the whole page, bestie π«Ά this version dropped way back on January 24, 2012, and yeah β it's still filed under parallel-rsync(1) in the General Commands Manual. go sync something parallel. slay. πβ¨
π¦ where this page comes from
- debian bookworm: pssh 2.3.4-2 Β· BSD-3-Clause
- debian trixie: pssh 2.3.5-2 Β· BSD-3-Clause
- ubuntu jammy: pssh 2.3.4-2 Β· BSD-3-Clause
- ubuntu noble: pssh 2.3.5-2 Β· BSD-3-Clause
- ubuntu questing: pssh 2.3.5-2
- ubuntu resolute: pssh 2.3.6-1 Β· BSD-3-Clause
- ubuntu stonking: pssh 2.3.6-1 Β· BSD-3-Clause
- π girlified by deepseek-ai/DeepSeek-V4.1-Flash on : a language model's rewrite of the original, under its terms