ramalama-inspect 1

NAME

ramalama-inspect - inspect the specified AI Model

SYNOPSIS

ramalama inspect [options] model

DESCRIPTION

Inspect the specified AI Model about additional information like the repository, its metadata and tensor information.

OPTIONS

  --all

Print all available information about the AI Model. By default, only a basic subset is printed.

  --get=field

Print the value of a specific metadata field of the AI Model. This option supports autocomplete with the available metadata fields of the given model. The special value all will print all available metadata fields and values.

  --help, -h

Print usage message

  --json

Print the AI Model information in json format.

EXAMPLES

Inspect the smollm:135m model for basic information

    $ ramalama inspect smollm:135m
    smollm:135m
       Path: /var/lib/ramalama/models/ollama/smollm:135m
       Registry: ollama
       Format: GGUF
       Version: 3
       Endianness: little
       Metadata: 39 entries
       Tensors: 272 entries

Inspect the smollm:135m model for all information in json format

    $ ramalama inspect smollm:135m --all --json
    {
        "Name": "smollm:135m",
        "Path": "/home/mengel/.local/share/ramalama/models/ollama/smollm:135m",
        "Registry": "ollama",
        "Format": "GGUF",
        "Version": 3,
        "LittleEndian": true,
        "Metadata": {
            "general.architecture": "llama",
            "general.base_model.0.name": "SmolLM 135M",
            "general.base_model.0.organization": "HuggingFaceTB",
            "general.base_model.0.repo_url": "https://huggingface.co/HuggingFaceTB/SmolLM-135M",
            ...
        },
        "Tensors": [
            {
                "dimensions": [
                    576,
                    49152
                ],
                "n_dimensions": 2,
                "name": "token_embd.weight",
                "offset": 0,
                "type": 8
            },
            ...
        ]
    }

Use the autocomplete function of --get to view a list of fields:

    $ ramalama inspect smollm:135m --get general.
    general.architecture               general.languages
    general.base_model.0.name          general.license
    general.base_model.0.organization  general.name
    general.base_model.0.repo_url      general.organization
    general.base_model.count           general.quantization_version
    general.basename                   general.size_label
    general.datasets                   general.tags
    general.file_type                  general.type
    general.finetune

Print the value of a specific field of the smollm:135m model:

    $ ramalama inspect smollm:135m --get tokenizer.chat_template
    {% for message in messages %}{{'<|im_start|>' + message['role'] + '

Print all key-value pairs of the metadata of the smollm:135m model:

    $ ramalama inspect smollm:135m --get all
    general.architecture: llama
    general.base_model.0.name: SmolLM 135M
    general.base_model.0.organization: HuggingFaceTB
    general.base_model.0.repo_url: https://huggingface.co/HuggingFaceTB/SmolLM-135M
    general.base_model.count: 1

SEE ALSO

ramalama(1)

HISTORY

Feb 2025, Originally compiled by Michael Engel ⟨mengel@redhat.com⟩