Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.gourmand.dev/llms.txt

Use this file to discover all available pages before exploring further.

Get started with Llama.cpp

Configuration

config.yaml
models:
  - name: <MODEL_NAME>
    provider: llama.cpp
    model: <MODEL_ID>
    apiBase: http://localhost:8080