Evaluations API
Define agent evaluations, run them, and inspect results.
For API groups, see Evaluations API.
Documentation Index
Fetch the complete documentation index at: /docs/llms.txt
Use this file to discover all available pages before exploring further.
Define agent evaluations, run them, and inspect results.
| Tool | Description |
|---|---|
| List eval runs | List run projections for a project eval, newest first by default. |
| Get eval run | Get a run projection for a project eval |
| Get eval run report | Read the stored JSON report for an eval run |
| Run eval | Start a project eval run against the real agent runtime |
| Tool | Description |
|---|---|
| List evals | List source-backed eval definitions for a project |
| Get eval | Get a source-backed eval definition |
| Get eval source | Get editable source information for a project eval definition |
| Create eval | Create a structured project eval source file |
| Update eval | Update a structured project eval source file |