LLAMA-GGUF-SPLIT(1)

📦
version 10438 · 2 versions
, in ubuntu stonking

💅 NAME 💅

llama-gguf-split — bestie's little GGUF glow-up tool ✨

okay so like. picture this: you got GGUF files. you got too many, or too few, or they're one big chonky boi and you need them to be several smaller chonky bois. that's literally the whole job. it's giving file-shapeshifting, it's giving main character energy, it's giving llama-gguf-split. 🦋

🌸 SYNOPSIS 🌸

llama-gguf-split [options] GGUF_IN GGUF_OUT

✨ DESCRIPTION ✨

so the whole vibe is: you take GGUF_IN, you apply a GGUF operation to it, and it comes out the other side as GGUF_OUT. apply a GGUF operation on IN to OUT. slay. 💅

here's your options, queen 👑

  • -h, --help — show this help message and exit. classic. the "help me bestie" button 🫶
  • --version — show version and build info. receipts! you wanna know exactly which build you're running, this tells you 📋
  • --split — split GGUF to multiple GGUF. this one is enabled by default, so if you do nothing, congrats, you're already splitting 💀
  • --merge — merge multiple GGUF to a single GGUF. the reverse girlie. many become one 🧚
  • --split-max-tensors — max tensors in each split. default is 128 if you don't say anything 🔢
  • --split-max-size N(M|G) — max size per split. you pass a number with M or G and that's your ceiling, no cap (well, technically a cap, that's the point) ⭐
  • --no-tensor-first-split — do not add tensors to the first split. this is disabled by default, so normally the first split does get tensors 🙈
  • --dry-run — only print out a split plan and exit, without writing any new files. the "let me see the fit before I commit" option 👀
  • --delete-splits — delete the split files during merge to free up disk space 🗑️
WARNING: --delete-splits is unsafe and will leave you in an unrecoverable state if something fails during the merge. bestie. BESTIE. i am begging you. if that merge hiccups you are not getting those files back. do not play with this unless you're truly built different. 😭

and that's the whole page, you ate that 🎀 this was llama-gguf-split from the debian manual, dated September 2026 — go forth and split (or merge) responsibly, love u, bye 💖✨

📦 where this page comes from