makeflow_mpi_starter(1)

πŸ“¦ version 9.9, in debian bookworm, ubuntu jammy, ubuntu noble

πŸ’– makeflow_mpi_starter β€” bestie edition πŸ’–

okay so this is makeflow_mpi_starter(1), one of the lil stars of the Cooperative Computing Tools squad, and she is literally the glow-up your MPI cluster has been waiting for. sit down, grab a boba, we're doing this πŸ§‹βœ¨


✨ NAME ✨

makeflow_mpi_starter β€” the mpi wrapper program for makeflow and workqueue, no cap.


πŸ¦‹ SYNOPSIS πŸ¦‹

makeflow_mpi_starter [options]

that's it. that's the whole vibe.


🌸 DESCRIPTION 🌸

so makeflow_mpi_starter is an MPI wrapper program that will start up Makeflow and WorkQueue on the nodes that got allocated to it. that's the entire job, and she does it gorgeously πŸ’…

she exists as a simple, easy way for users to take advantage of an MPI-based system while using Makeflow and WorkQueue. the way that you use her is so unserious β€” you literally just call her like you would a regular MPI program. like, no special ritual, no candles, nothing. πŸ•―οΈ

🫢 important bestie note: for the program to work, cctools needs to be configured with --with-mpi-path. don't skip this. she will not run and you will be sad 😭

πŸ‘‘ OPTIONS πŸ‘‘

okay so when makeflow_mpi_starter is ran without any arguments, she will attempt to execute the workflow specified by the Makeflow dagfile. main character energy fr fr.

πŸŽ€ Commands

  • -m, --makeflow-arguments=<option> β€” options to pass along to makeflow, like the dagfile and stuff. yeah she's the messenger, and she delivers πŸ’Œ
  • -p, --makeflow-port=<port> β€” the port for Makeflow to use when she's communicating with workers. set it, love it.
  • -q, --workqueue-arguments=<option> β€” options to pass to work_queue_worker. hand 'em over, she'll carry them.
  • -c, --copy-out=<location> β€” where to copy out all files produced. everything you made? yeah, it goes here. 🎁
  • -d, --debug=<debugprefix> β€” base Debug file name. debugging era, we love to see it.
  • -h, --help β€” print out this help. the classic. the icon. when in doubt, ask for help 🫢

πŸ’€ EXIT STATUS πŸ’€

  • On success, returns zero. slay ✨
  • On failure, returns non-zero. not slay 😭

πŸ”₯ EXAMPLES πŸ”₯

Run with debugging

mpirun -np $NUM_PROC makeflow_mpi_starter -m "Makeflow.mf" -d mydebug

Run makeflow with custom port

mpirun -np $NUM_PROC makeflow_mpi_starter -m "Makeflow.mf" -d mydebug -p 9001

Run makeflow with garbage collection

mpirun -np $NUM_PROC makeflow_mpi_starter -m "-gall Makeflow.mf" -d mydebug

Example SGE submission script

#!/bin/csh

#$ -pe mpi-* 120
#$ -q debug
#$ -N mpi_starter_example

module load ompi

mpirun -np $NSLOTS makeflow_mpi_starter -m "Makeflow.mf" -d mydebug

look at that submission script. she's structured. she's organized. she's giving ✨ responsible cluster user ✨


The Cooperative Computing Tools are Copyright (C) 2005-2019 The University of Notre Dame. This software is distributed under the GNU General Public License. See the file COPYING for details.

(yeah, the lawyers said we have to include this, and honestly? iconic of them to protect the community like that πŸ’œ)


🌈 SEE ALSO 🌈

SEE_ALSO_WORKQUEUE


and that's the whole page bestie!! this was CCTools 8.0.0 DEVELOPMENT, brought to you by the Cooperative Computing Tools crew. now go forth and mpirun responsibly πŸ«ΆπŸ’–βœ¨

πŸ“¦ where this page comes from