At a glance
- Availability: Experimental (how to enable).
- Auth: API key.
- Connection: The key comes from
FIREWORKS_API_KEY. - Docs: https://docs.fireworks.ai/api-reference/introduction
Credentials
Set these per environment. See Connect an integration.| Variable | Required | Description |
|---|---|---|
FIREWORKS_API_KEY | Yes | Fireworks AI API key from account settings Docs. |
Setup
- Create a Fireworks AI account: Go to https://app.fireworks.ai and sign up or sign in. New accounts include free credits for testing serverless models.
- Create an API key: Open the API Keys page under account settings (https://app.fireworks.ai/settings/users/api-keys) and create a new key.
- Store the key: Copy the key and add it to your .env file as FIREWORKS_API_KEY=…
- Verify access: Run the List Models tool to confirm the key works. A 401 means the key is wrong or revoked.
- The inference API is OpenAI-compatible under https://api.fireworks.ai/inference/v1
- Serverless model IDs use the accounts/fireworks/models/<name> format
- Inference is billed per token once free credits are exhausted
Tools
| Tool | Access | Description |
|---|---|---|
| List Models | Read | List the models available on Fireworks AI |
| Create Chat Completion | Write | Generate a chat completion from a list of messages |
| Create Completion | Write | Generate a text completion from a raw prompt |
| Create Embedding | Write | Create an embedding vector for input text |
Example prompts
- List the models available on Fireworks AI for my account.
- Use Fireworks AI to generate a chat response to a prompt I provide.