Skip to main content

At a glance

Credentials

Set these per environment. See Connect an integration.
VariableRequiredDescription
COHERE_API_KEYYesCohere API key from the Cohere dashboard Docs.

Setup

  1. Create a Cohere account: Go to https://dashboard.cohere.com and sign up or sign in. New accounts get a free trial key that works for evaluation without billing.
  2. Create an API key: Open https://dashboard.cohere.com/api-keys. Use the trial key for testing, or click ‘New Production Key’ for production use (requires billing details).
  3. Store the key: Copy the key and add it to your .env file as COHERE_API_KEY=…
  4. Verify access: Run the List Models tool to confirm the key works. A 401 means the key is wrong or revoked.
  • Trial keys are free but heavily rate limited - switch to a production key for real workloads
  • Chat, Embed, and Rerank calls are billed per token/search unit on production keys
Provider API reference: https://docs.cohere.com/reference/about

Tools

ToolAccessDescription
List ModelsReadList the Cohere models available to the API key
Create ChatWriteGenerate a chat response with a Cohere Command model (v2 Chat API)
Create EmbeddingWriteCreate embedding vectors for input texts (v2 Embed API)
Rerank DocumentsWriteRank a list of documents by relevance to a query (v2 Rerank API)

Example prompts

  • List the Cohere models available to my API key and note which endpoints each supports.
  • Use Cohere Rerank to order a list of documents I provide by relevance to my query.