Skip to main content
Cloudflare Workers AI can be used for both chat and tab autocompletion in Gobi. Here is an example of Cloudflare Workers AI configuration:
  • YAML
  • JSON
config.yaml
models:
  - name: Llama 3 8B
    provider: cloudflare
    apiKey: <YOUR_CLOUDFARE_API_KEY>
    model: "@cf/meta/llama-3-8b-instruct"
    contextLength: 2400
    defaultCompletionOptions:
      maxTokens: 500
    roles:
      - chat
    env:
      accountId: YOUR CLOUDFLARE ACCOUNT ID 
  - name: DeepSeek Coder 6.7b Instruct
    provider: cloudflare
    apiKey: <YOUR_CLOUDFARE_API_KEY>
    model: "@hf/thebloke/deepseek-coder-6.7b-instruct-awq"
    contextLength: 2400
    defaultCompletionOptions:
      maxTokens: 500
    roles:
      - chat
    env:
      accountId: YOUR CLOUDFLARE ACCOUNT ID
  - name: DeepSeek 7b
    provider: cloudflare
    apiKey: <YOUR_CLOUDFARE_API_KEY>
    model: "@hf/thebloke/deepseek-coder-6.7b-base-awq"
    roles:
      - autocomplete
    env:
      accountId: YOUR CLOUDFLARE ACCOUNT ID
Visit the Cloudflare dashboard to create an API key. Review available models on Workers AI View the source