Create TaskAgent Eval Set

POST

/org/:org_id/project/:project_id/task-agent/:task_agent_id/eval/set

POST

/api/v1/org/:org_id/project/:project_id/task-agent/:task_agent_id/eval/set

$ curl -X POST https://app.rightbrain.ai/api/v1/org/org_id/project/project_id/task-agent/task_agent_id/eval/set \
>      -H "Authorization: Bearer <token>" \
>      -H "Content-Type: application/json" \
>      -d '{
>   "name": "Support quality golden set",
>   "task_agent_run_ids": [
>     "0190b234-1111-2222-3333-444444444444",
>     "0190b234-5555-6666-7777-888888888888"
>   ],
>   "description": "Reference conversations for support triage."
> }'

1 {
2   "id": "0190d234-1111-2222-3333-444444444444",
3   "name": "Support quality golden set",
4   "task_agent_id": "019df849-e106-3301-5894-291b4c9c6cab",
5   "project_id": "0190a234-9876-5432-10ab-cdef01234567",
6   "created": "2026-07-27T18:53:36.814214Z",
7   "modified": "2026-07-27T18:53:36.814214Z",
8   "task_agent_run_ids": [
9     "0190b234-1111-2222-3333-444444444444",
10     "0190b234-5555-6666-7777-888888888888"
11   ],
12   "description": "Reference conversations for support triage.",
13   "created_by_user_id": "0190c234-1111-2222-3333-444444444444"
14 }

Create a reusable TaskAgent eval set from completed, replayable TaskAgent runs. Reference inputs and outputs are snapshotted for stable future evals but are not exposed in this API version.

Authentication

AuthorizationBearer

API key or access token, sent as Authorization: Bearer <token>. The simplest option: create an API key in your dashboard under Settings, then paste it here.

AuthorizationBearer

API key or access token, sent as Authorization: Bearer <token>. The simplest option: create an API key in your dashboard under Settings, then paste it here.

Path parameters

org_idstringRequiredformat: "uuid"

The organization ID

project_idstringRequiredformat: "uuid"

The project ID

task_agent_idstringRequiredformat: "uuid"

The task agent ID

Request

This endpoint expects an object.

namestringRequired1-64 characters

task_agent_run_idslist of stringsRequired

descriptionstring or nullOptional<=256 characters

Response

TaskAgent eval set created

idstringformat: "uuid"

namestring

task_agent_idstringformat: "uuid"

project_idstringformat: "uuid"

createdstring

modifiedstring

task_agent_run_idslist of stringsRead-only

descriptionstring or nullOptional

created_by_user_idstring or nullOptionalformat: "uuid"

Errors

400

Bad Request Error

401

Unauthorized Error

403

Forbidden Error

404

Not Found Error

422

Unprocessable Entity Error

500

Internal Server Error