> ## Documentation Index
> Fetch the complete documentation index at: https://veryfront.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Groq

> Run fast chat completions on Groq-hosted open models via the OpenAI-compatible Groq API

## At a glance

* **Availability**: Experimental ([how to enable](/cloud/integrations)).
* **Auth**: API key.
* **Connection**: The key comes from `GROQ_API_KEY`.
* **Docs**: [https://console.groq.com/docs/api-reference](https://console.groq.com/docs/api-reference)

## Credentials

Set these per environment. See [Connect an integration](/cloud/integrations).

| Variable       | Required | Description                                                                                   |
| -------------- | -------- | --------------------------------------------------------------------------------------------- |
| `GROQ_API_KEY` | Yes      | Groq API key from the Groq console (starts with gsk\_) [Docs](https://console.groq.com/keys). |

## Setup

1. **Create a Groq account**: Go to [https://console.groq.com](https://console.groq.com) and sign up or sign in. The free tier works for testing without billing.
2. **Create an API key**: Open [https://console.groq.com/keys](https://console.groq.com/keys), click 'Create API Key', and give it a descriptive name (e.g. 'Veryfront Integration').
3. **Store the key**: Copy the key immediately - it is only shown once. Add it to your .env file as GROQ\_API\_KEY=gsk\_...
4. **Verify access**: Run the List Models tool to confirm the key works. A 401 means the key is wrong or revoked.

* The API is OpenAI-compatible - requests use the /openai/v1 path prefix
* Free-tier keys are rate limited per model; upgrade to a paid tier for higher limits
* Chat completions are billed per token on paid tiers

Provider API reference: [https://console.groq.com/docs/api-reference](https://console.groq.com/docs/api-reference)

## Tools

| Tool                   | Access | Description                                        |
| ---------------------- | ------ | -------------------------------------------------- |
| List Models            | Read   | List the models available on Groq                  |
| Get Model              | Read   | Get details about a specific Groq model            |
| Create Chat Completion | Write  | Generate a chat completion from a list of messages |
| List Batches           | Read   | List the organization's batch jobs                 |

## Example prompts

* List the models available on Groq and note their context windows.
* Use Groq to generate a response to a prompt I provide.