Create Eval Set

POST

/org/:org_id/project/:project_id/task/:task_id/eval/set

POST

/api/v1/org/:org_id/project/:project_id/task/:task_id/eval/set

$ curl -X POST https://app.rightbrain.ai/api/v1/org/org_id/project/project_id/task/task_id/eval/set \
>      -H "Authorization: Bearer <token>" \
>      -H "Content-Type: application/json" \
>      -d '{
>   "name": "Ticket Triage baseline",
>   "task_run_ids": [
>     "019f8a04-8e60-7b85-af37-6e9fb14d8fa4",
>     "019f8a05-9f71-7c96-b048-7fa0c25f9ab5"
>   ],
>   "description": "Two representative ticket-triage runs used as the reference baseline"
> }'

1 {
2   "id": "019fa4ec-98a8-9c34-e8f6-09f54481dd89",
3   "name": "Ticket Triage baseline",
4   "task_id": "019f8a00-1c3d-7e42-b8f1-2a5c9d4e7b60",
5   "project_id": "019f6b10-2e8a-7c91-9a3d-6e0f8b2c1d47",
6   "task_run_ids": [
7     "019f8a04-8e60-7b85-af37-6e9fb14d8fa4",
8     "019f8a05-9f71-7c96-b048-7fa0c25f9ab5"
9   ],
10   "created": "2026-07-27T18:53:16.776040Z",
11   "modified": "2026-07-27T18:53:16.776040Z",
12   "description": "Two representative ticket-triage runs used as the reference baseline",
13   "created_by_user_id": "019f6c10-1a2b-7c3d-8e4f-5a6b7c8d9e01"
14 }

Create a reusable set of successful task runs for evals.

The set is later used as the reference baseline when comparing a candidate revision’s outputs against it (see Start Eval Run).

Authentication

AuthorizationBearer

API key or access token, sent as Authorization: Bearer <token>. The simplest option: create an API key in your dashboard under Settings, then paste it here.

AuthorizationBearer

API key or access token, sent as Authorization: Bearer <token>. The simplest option: create an API key in your dashboard under Settings, then paste it here.

Path parameters

org_idstringRequiredformat: "uuid"

The organization ID

project_idstringRequiredformat: "uuid"

The project ID

task_idstringRequiredformat: "uuid"

The task ID

Request

This endpoint expects an object.

namestringRequired1-64 characters

task_run_idslist of stringsRequired

descriptionstring or nullOptional<=256 characters

Response

Eval set created successfully

idstringformat: "uuid"

namestring

task_idstringformat: "uuid"

project_idstringformat: "uuid"

task_run_idslist of strings

createdstring

modifiedstring

descriptionstring or nullOptional

created_by_user_idstring or nullOptionalformat: "uuid"

Errors

400

Bad Request Error

401

Unauthorized Error

403

Forbidden Error

404

Not Found Error

422

Unprocessable Entity Error