At a glance
- Availability: Experimental (how to enable).
- Auth: API key.
- Connection: The key comes from
TOGETHER_API_KEY. - Docs: https://docs.together.ai/docs/quickstart
Credentials
Set these per environment. See Connect an integration.| Variable | Required | Description |
|---|---|---|
TOGETHER_API_KEY | Yes | Together AI API key from account settings Docs. |
Setup
- Create a Together AI account: Go to https://api.together.ai and sign up or sign in. New accounts include trial credits for testing.
- Create an API key: Open Settings → API Keys at https://api.together.ai/settings/api-keys and create a new key.
- Store the key: Copy the key and add it to your .env file as TOGETHER_API_KEY=…
- Verify access: Run the List Models tool to confirm the key works. A 401 means the key is wrong or revoked.
- The official base URL is https://api.together.ai/v1 (the legacy api.together.xyz host also resolves)
- Inference is billed per token (text) or per image step - check model pricing in the dashboard before large jobs
Tools
| Tool | Access | Description |
|---|---|---|
| List Models | Read | List the models available on Together AI |
| Create Chat Completion | Write | Generate a chat completion from a list of messages |
| Create Embedding | Write | Create an embedding vector for input text |
| Generate Image | Write | Generate an image from a text prompt |
Example prompts
- List the models available on Together AI and group them by type.
- Use Together AI to generate an image from a prompt I provide.