Create Eval Set

Create a reusable set of successful task runs for evals.

Authentication

AuthorizationBearer

Bearer token authentication using JWT tokens from Ory Kratos/Hydra

Path parameters

org_idstringRequiredformat: "uuid"
The organization ID
project_idstringRequiredformat: "uuid"
The project ID
task_idstringRequiredformat: "uuid"
The task ID

Request

This endpoint expects an object.
namestringRequired1-64 characters
task_run_idslist of stringsRequired
descriptionstring or nullOptional<=256 characters

Response

Successful Response
idstringformat: "uuid"
namestring
task_idstringformat: "uuid"
project_idstringformat: "uuid"
task_run_idslist of strings
createdstring
modifiedstring
descriptionstring or null
created_by_user_idstring or nullformat: "uuid"

Errors

400
Bad Request Error
403
Forbidden Error
422
Unprocessable Entity Error