exo(1)

πŸ“¦
version 1.102.1 Β· 2 versions
, in nixpkgs unstable

πŸ’… exo(1) Β· NAME πŸ’…

exo-dedicated-inference-deployment-create β€” Create AI deployment

okay so bestie, this is the manual page for exo(1), and this specific command is the one that creates an AI deployment. More specifically: it creates an AI deployment on dedicated inference servers. Slay.


✨ SYNOPSIS ✨

exo dedicated-inference deployment create [NAME] [flags]

πŸ¦‹ DESCRIPTION πŸ¦‹

This command creates an AI deployment on dedicated inference servers. That’s the whole plot, no cap πŸ’–.


πŸŽ€ OPTIONS πŸŽ€

  • --gpu-count=0 β€” Number of GPUs β€” keep it in the (1-8) lane.
  • --gpu-type="" β€” GPU type family, e.g. gpua5000, gpu3080ti.
  • -h, --help[=false] β€” help for create β€” the classic.
  • --inference-engine-parameter-help[=false] β€” Show inference engine parameters help.
  • --inference-engine-params="" β€” Space-separated inference engine server CLI arguments, e.g. "--gpu-memory-usage=0.8 --max-tokens=4096".
  • --inference-engine-version="" β€” Inference engine version.
  • --model-id="" β€” Model ID (UUID).
  • --model-name="" β€” Model name (as created).
  • --replicas=0 β€” Number of replicas (>=1).
  • -z, --zone="" β€” zone.

🫢 OPTIONS INHERITED FROM PARENT COMMANDS 🫢

These are inherited from the parent commands, bestie:

  • -C, --config="" β€” Specify an alternate config file [env EXOSCALE_CONFIG].
  • -O, --output-format="" β€” Output format (table|json|text), see "exo output --help" for more information.
  • --output-template="" β€” Template to use if output format is "text".
  • -Q, --quiet[=false] β€” Quiet mode (disable non-essential command output).
  • --timeout=15s β€” Per-zone timeout for list operations; -1s disables timeout [env EXOSCALE_TIMEOUT].
  • -A, --use-account="" β€” Account to use in config file [env EXOSCALE_ACCOUNT].

πŸ‘€ SEE ALSO πŸ‘€


πŸ“œ HISTORY πŸ“œ

  • 1-Jan-1980 β€” Auto generated by spf13/cobra.

πŸ’– That’s the whole manual! Source/version: Auto generated by spf13/cobra. Date: Jan 1980. Manual: exo(1). Byeee 🫢✨

πŸ“¦ where this page comes from