Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.gourmand.dev/llms.txt

Use this file to discover all available pages before exploring further.

Discover Amazon Bedrock models here
Get started with Amazon Bedrock

​
Configuration

config.yaml
models:
  - name: <MODEL_NAME>
    provider: bedrock
    model: <MODEL_ID>
    env:
      region: us-east-1
      profile: bedrock
    roles:
      - chat
Check out a more advanced configuration here

​
How to Enable Prompt Caching with Amazon Bedrock

Bedrock allows Claude models to cache tool payloads, system messages, and chat messages between requests. Enable this behavior by adding promptCaching: true under defaultCompletionOptions in your model configuration.
config.yaml
models:
  - name: <MODEL_NAME>
    provider: bedrock
    model: <MODEL_ID>
    defaultCompletionOptions:
      promptCaching: true
Prompt caching is not supported in JSON configuration files, so use the YAML syntax above to enable it.

​
How to Set Up Authentication for Amazon Bedrock

Authentication will be through temporary or long-term credentials in ~/.aws/credentials under a configured profile (e.g. “bedrock”). 
[bedrock]
aws_access_key_id = abcdefg
aws_secret_access_key = hijklmno
aws_session_token = pqrstuvwxyz # Optional: means short term creds.
You can also use an AWS accessKeyId and secretAccessKey for authentication instead of a local credentials profile.
config.yaml
models:
  - name: <MODEL_NAME>
    provider: bedrock
    model: <MODEL_ID>
    env:
      region: us-east-1
      accessKeyId: ${{ secrets.AWS_ACCESS_KEY_ID }} # can also enter key inline here for local assistants
      secretAccessKey: ${{ secrets.AWS_SECRET_ACCESS_KEY }} # can also enter key inline here for local assistants
    roles:
      - chat

​
How to Configure Custom Imported Models with Amazon Bedrock

To setup Bedrock using custom imported models, add the following to your config file:
config.yaml
models:
  - name: <MODEL_NAME>
    provider: bedrockimport
    model: <MODEL_ID>
    env:
      region: us-west-2
      profile: bedrock
      modelArn: arn:aws:bedrock:us-west-2:XXXXX:imported-model/XXXXXX
Authentication will be through temporary or long-term credentials in ~/.aws/credentials under a configured profile (e.g. “bedrock”). 
[bedrock]
aws_access_key_id = abcdefg
aws_secret_access_key = hijklmno
aws_session_token = pqrstuvwxyz # Optional: means short term creds.