List Eval Runs
curl --request GET \
--url https://api.veryfront.com/projects/{project_reference}/evals/{eval_id}/runs \
--header 'Authorization: Bearer <token>'{
"data": [
{
"kind": "eval-run",
"runId": "<string>",
"evalId": "<string>",
"targetKind": "agent",
"target": "<string>",
"summary": {
"records": 123,
"passed": 123,
"failed": 123,
"passRate": 123,
"metrics": [
{
"name": "<string>",
"passed": 123,
"failed": 123,
"skipped": 123,
"passRate": 123
}
],
"skippedResults": 123,
"duration": {
"totalMs": 123,
"minMs": 123,
"maxMs": 123,
"meanMs": 123,
"p50Ms": 123,
"p95Ms": 123
},
"usage": {
"inputTokens": 123,
"outputTokens": 123,
"totalTokens": 123,
"costUsd": 123
},
"gateFailures": [
{
"recordId": "<string>",
"exampleId": "<string>",
"repetition": 123,
"name": "<string>",
"explanation": "<string>",
"evidence": {}
}
],
"failedExamples": [
{
"exampleId": "<string>",
"records": 123,
"passed": 123,
"failed": 123,
"passRate": 123,
"flaky": true
}
],
"flakes": {
"examples": 123,
"stablePassed": 123,
"stableFailed": 123,
"flaky": 123
}
},
"reportPath": "<string>",
"metadata": {},
"createdAt": "<string>",
"startedAt": "<string>",
"completedAt": "<string>",
"source": {
"filePath": "<string>",
"exportName": "<string>",
"content": "<string>"
},
"error": null
}
]
}Lists eval run projections for an eval definition.
GET
/
projects
/
{project_reference}
/
evals
/
{eval_id}
/
runs
List Eval Runs
curl --request GET \
--url https://api.veryfront.com/projects/{project_reference}/evals/{eval_id}/runs \
--header 'Authorization: Bearer <token>'{
"data": [
{
"kind": "eval-run",
"runId": "<string>",
"evalId": "<string>",
"targetKind": "agent",
"target": "<string>",
"summary": {
"records": 123,
"passed": 123,
"failed": 123,
"passRate": 123,
"metrics": [
{
"name": "<string>",
"passed": 123,
"failed": 123,
"skipped": 123,
"passRate": 123
}
],
"skippedResults": 123,
"duration": {
"totalMs": 123,
"minMs": 123,
"maxMs": 123,
"meanMs": 123,
"p50Ms": 123,
"p95Ms": 123
},
"usage": {
"inputTokens": 123,
"outputTokens": 123,
"totalTokens": 123,
"costUsd": 123
},
"gateFailures": [
{
"recordId": "<string>",
"exampleId": "<string>",
"repetition": 123,
"name": "<string>",
"explanation": "<string>",
"evidence": {}
}
],
"failedExamples": [
{
"exampleId": "<string>",
"records": 123,
"passed": 123,
"failed": 123,
"passRate": 123,
"flaky": true
}
],
"flakes": {
"examples": 123,
"stablePassed": 123,
"stableFailed": 123,
"flaky": 123
}
},
"reportPath": "<string>",
"metadata": {},
"createdAt": "<string>",
"startedAt": "<string>",
"completedAt": "<string>",
"source": {
"filePath": "<string>",
"exportName": "<string>",
"content": "<string>"
},
"error": null
}
]
}Authorizations
bearerAuthapiKeyAuth
Use a JWT bearer token or a Veryfront API key in the Authorization header.
Query Parameters
Required range:
0 < x <= 100Response
Eval runs
Show child attributes
Show child attributes
⌘I