slurm_submit_workers(1)

πŸ“¦
version 9.9 Β· 3 versions
, in debian bookworm, ubuntu jammy, ubuntu noble

✨ slurm_submit_workers(1) β€” the Cooperative Computing Tools one ✨

okay bestie, gather round, because this is the little command that yeets your work_queue_worker onto a SLURM cluster so you don't have to babysit it πŸ’…


🌸 NAME 🌸

slurm_submit_workers β€” submit work_queue_worker to a SLURM cluster. that's the whole job, no cap.


πŸ¦‹ SYNOPSIS πŸ¦‹

slurm_submit_workers [options] <servername> <port> <num-workers>

πŸ’– DESCRIPTION πŸ’–

so here's the vibe: slurm_submit_workers schedules work_queue_worker(1) to run on the SLURM batch system, going through its job submission interface, qsub. and how many workers are we scheduling and running? that's literally what the num-workers argument is for. it's the headcount 🫢

the servername and port arguments are the hostname and the port number of the manager that the work_queue_worker is gonna connect to. iconic, straightforward.

and here's the plot twist: those two arguments become optional when the auto mode option is specified for work_queue_worker. so if you're in auto mode, you can just... not. love that for you.

πŸŽ€ OPTIONS πŸŽ€

one bullet per option, no skips, we're doing all of them:

  • -M β€” name of the preferred manager for the worker.
  • -N <name> β€” preferred project name for work_queue_worker to connect.
  • -c <cores> β€” set the number of cores each worker should use (0=auto). default is 1.
  • -C <catalog> β€” set the catalog server for work_queue_worker to <catalog>. the <catalog> format is HOSTNAME:PORT.
  • -t <seconds> β€” abort work_queue_worker after this amount of idle time. default is 900s.
  • -d <subsystem> β€” enable debugging on the worker for this subsystem (try -d all to start).
  • -w <size> β€” set the TCP window size.
  • -i <time> β€” set the initial value for the backoff interval when the worker fails to connect to a manager. default is 1s.
  • -b <time> β€” set the maximum value for the backoff interval when the worker fails to connect to a manager. default is 60s.
  • -z <size> β€” set the available disk space threshold (in MB). when it gets exceeded, the worker will clean up and reconnect. default is 100MB.
  • -A <arch> β€” set the architecture string for the worker to report to the manager, instead of the value from uname.
  • -O <os> β€” set the operating system string for the worker to report to the manager, instead of the value from uname.
  • -s <path> β€” set the location where the worker's working directory gets created.
  • -p <parameters> β€” SLURM qsub parameters.
  • -h β€” show the help message. always here for you 🫢

πŸ”₯ EXIT STATUS πŸ”₯

  • on success, returns zero. slay.
  • on failure, returns non-zero. not slay, but informative.

🌈 EXAMPLES 🌈

exhibit one β€” submit 10 worker instances to run on SLURM and connect to a specific manager:

slurm_submit_workers manager.somewhere.edu 9123 10

exhibit two β€” submit 10 work_queue_worker instances to run on SLURM in auto mode, with their preferred project name set to Project_A and the abort timeout set to 3600 seconds:

slurm_submit_workers -a -t 3600 -M Project_A 10

The Cooperative Computing Tools are Copyright (C) 2005-2019 The University of Notre Dame. This software is distributed under the GNU General Public License. See the file COPYING for details.


🧚 SEE ALSO 🧚


okay that's the whole page, you ate it πŸ’– this little number is from CCTools 8.0.0 DEVELOPMENT, and yeah, it's slurm_submit_workers(1) in case you forgot which manpage you were living in. go submit some workers bestie, ily, bye πŸ¦‹βœ¨

πŸ“¦ where this page comes from