ramalama-daemon(1)

πŸ“¦
version 0.25.0 Β· 2 versions
, in fedora 43, fedora 44, nixos 26.05, nixpkgs unstable

πŸ’– ramalama-daemon(1) πŸ’–

okay so bestie, welcome to the ramalama-daemon era β€” the ramalama-daemon manual page, straight from the General Commands Manual section of the library. she's here to run a RamaLama REST server and she's serving ✨


🌸 NAME 🌸

ramalama-daemon β€” run a RamaLama REST server 🫢


πŸŽ€ SYNOPSIS πŸŽ€

ramalama daemon [options] [start|run]

πŸ¦‹ DESCRIPTION πŸ¦‹

Inspect the specified AI Model about additional information like the repository, its metadata and tensor information.

not me noticing the description is giving "inspect" energy while the title is giving "daemon" energy πŸ™ˆ but that is literally what the page says, so we keep it, periodt. no editing the facts, ever.

✨ OPTIONS ✨

  • --help, -h β€” print the usage message πŸ’…

πŸ‘‘ COMMANDS πŸ‘‘

  • start β€” pepares to run a new RamaLama REST server so it will be run either inside a RamaLama container or on the host 🧚
  • run β€” start a new RamaLama REST server πŸ”₯
yes bestie, pepares β€” that's the spelling in the original, we are not touching it, it's iconic in its own way πŸ’€

🌈 EXAMPLES 🌈

Inspect the smollm:135m model for basic information πŸ‘€

$ ramalama inspect smollm:135m
smollm:135m
   Path: /var/lib/ramalama/models/ollama/smollm:135m
   Registry: ollama
   Format: GGUF
   Version: 3
   Endianness: little
   Metadata: 39 entries
   Tensors: 272 entries

Inspect the smollm:135m model for all information in json format πŸ“

$ ramalama inspect smollm:135m --all --json
{
    "Name": "smollm:135m",
    "Path": "/home/mengel/.local/share/ramalama/models/ollama/smollm:135m",
    "Registry": "ollama",
    "Format": "GGUF",
    "Version": 3,
    "LittleEndian": true,
    "Metadata": {
        "general.architecture": "llama",
        "general.base_model.0.name": "SmolLM 135M",
        "general.base_model.0.organization": "HuggingFaceTB",
        "general.base_model.0.repo_url": "https://huggingface.co/HuggingFaceTB/SmolLM-135M",
        ...
    },
    "Tensors": [
        {
            "dimensions": [
                576,
                49152
            ],
            "n_dimensions": 2,
            "name": "token_embd.weight",
            "offset": 0,
            "type": 8
        },
        ...
    ]
}

the ... bits are literally in the page, bestie β€” do not go looking for the missing tensors, they are vibing offscreen πŸ¦‹


πŸ’œ SEE ALSO πŸ’œ

  • ramalama(1) β€” go read her next, she's the main character fr fr

⭐ HISTORY ⭐

Feb 2025, Originally compiled by Michael Engel mengel@redhat.com ⟨mailto:mengel@redhat.com⟩


and that's the whole page, bestie β€” every option, every command, every example, every last detail, preserved exactly and served with a bow πŸŽ€

signing off from ramalama-daemon(1), the General Commands Manual, born Feb 2025 β€” mwah πŸ’…βœ¨

πŸ“¦ where this page comes from