> ## Documentation Index
> Fetch the complete documentation index at: https://docs.gourmand.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Llama.cpp

<Info>
  Get started with [Llama.cpp](https://github.com/ggml-org/llama.cpp?tab=readme-ov-file#quick-start)
</Info>

## Configuration

<Tabs>
  <Tab title="YAML">
    ```yaml title="config.yaml" theme={null}
    models:
      - name: <MODEL_NAME>
        provider: llama.cpp
        model: <MODEL_ID>
        apiBase: http://localhost:8080
    ```
  </Tab>

  <Tab title="JSON (Deprecated)">
    ```json title="config.json" theme={null}
    {
      "models": [
        {
          "title": "<MODEL_NAME>",
          "provider": "llama.cpp",
          "model": "<MODEL_ID>"
          "apiBase": "http://localhost:8080"
        }
      ]
    }
    ```
  </Tab>
</Tabs>