Create eval - Veryfront

createEval(projectReference: String!, input: CreateEvalInput!): EvalSource!

Requires project.evals.write.

Arguments

Argument	Type	Required
`projectReference`	`String!`	Yes
`input`	`CreateEvalInput!`	Yes

Input fields

input

CreateEvalInput

Field	Type	Required	Description
`name`	`String!`	Yes	The eval id is derived from the name.
`description`	`String`	No
`target`	`String!`	Yes	The identifier of the agent the eval runs against.
`dataset`	`EvalDatasetInput!`	Yes
`metrics`	`[EvalMetricInput!]`	No	Default none.
`repetitions`	`Int`	No	How often each example runs; default 1.
`tags`	`[String!]`	No
`metadata`	`JSONObject`	No
`sourceTargetKind`	`WriteTargetKind`	No	The source to write; default project.
`targetBranchId`	`ID`	No	Required with the kind preview_branch.

Response

Returns EvalSource!. Open the type for its fields and nested types.

Field	Type	Description
`id`	`ID!`
`name`	`String!`
`description`	`String`
`targetKind`	`EvalTargetKind!`
`target`	`String!`
`sourcePath`	`String!`
`exportName`	`String!`
`source`	`String!`	The source text of the eval file.

All fields of EvalSource. Types marked with ! cannot be null. Lists use [Type] notation. The type index lists all published input and response types.

Example

mutation CreateEval($projectReference: String!, $input: CreateEvalInput!) {
  createEval(projectReference: $projectReference, input: $input) {
    id
    name
    capabilities
    description
    dynamicFields
  }
}

{
  "projectReference": "00000000-0000-4000-8000-000000000001",
  "input": {
    "name": "example",
    "target": "example",
    "dataset": {
      "kind": "inline",
      "editable": false,
      "dynamic": false
    }
  }
}