At a glance
- Availability: Experimental (how to enable).
- Auth: API key.
- Connection: The key comes from
GROQ_API_KEY. - Docs: https://console.groq.com/docs/api-reference
Credentials
Set these per environment. See Connect an integration.| Variable | Required | Description |
|---|---|---|
GROQ_API_KEY | Yes | Groq API key from the Groq console (starts with gsk_) Docs. |
Setup
- Create a Groq account: Go to https://console.groq.com and sign up or sign in. The free tier works for testing without billing.
- Create an API key: Open https://console.groq.com/keys, click ‘Create API Key’, and give it a descriptive name (e.g. ‘Veryfront Integration’).
- Store the key: Copy the key immediately - it is only shown once. Add it to your .env file as GROQ_API_KEY=gsk_…
- Verify access: Run the List Models tool to confirm the key works. A 401 means the key is wrong or revoked.
- The API is OpenAI-compatible - requests use the /openai/v1 path prefix
- Free-tier keys are rate limited per model; upgrade to a paid tier for higher limits
- Chat completions are billed per token on paid tiers
Tools
| Tool | Access | Description |
|---|---|---|
| List Models | Read | List the models available on Groq |
| Get Model | Read | Get details about a specific Groq model |
| Create Chat Completion | Write | Generate a chat completion from a list of messages |
| List Batches | Read | List the organization’s batch jobs |
Example prompts
- List the models available on Groq and note their context windows.
- Use Groq to generate a response to a prompt I provide.