Create TaskAgent Eval Set

POST

/org/:org_id/project/:project_id/task-agent/:task_agent_id/eval/set

Create a reusable TaskAgent eval set from completed, replayable TaskAgent runs. Reference inputs and outputs are snapshotted for stable future evals but are not exposed in this API version.

Authentication

AuthorizationBearer

Bearer token authentication using JWT tokens from Ory Kratos/Hydra

Path parameters

org_idstringRequiredformat: "uuid"

The organization ID

project_idstringRequiredformat: "uuid"

The project ID

task_agent_idstringRequiredformat: "uuid"

The task agent ID

Request

This endpoint expects an object.

namestringRequired1-64 characters

task_agent_run_idslist of stringsRequired

descriptionstring or nullOptional<=256 characters

Response

Successful Response

idstringformat: "uuid"

namestring

task_agent_idstringformat: "uuid"

project_idstringformat: "uuid"

createdstring

modifiedstring

task_agent_run_idslist of stringsRead-only

descriptionstring or null

created_by_user_idstring or nullformat: "uuid"

Errors

400

Bad Request Error

403

Forbidden Error

404

Not Found Error

422

Unprocessable Entity Error

$	curl -X POST https://app.rightbrain.ai/api/v1/org/org_id/project/project_id/task-agent/task_agent_id/eval/set \
>	-H "Authorization: Bearer <token>" \
>	-H "Content-Type: application/json" \
>	-d '{
>	"name": "Support quality golden set",
>	"task_agent_run_ids": [
>	"0190b234-1111-2222-3333-444444444444",
>	"0190b234-5555-6666-7777-888888888888"
>	],
>	"description": "Reference conversations for support triage."
>	}'

1	{
2	"id": "string",
3	"name": "string",
4	"task_agent_id": "string",
5	"project_id": "string",
6	"created": "string",
7	"modified": "string",
8	"task_agent_run_ids": [
9	"string"
10	],
11	"description": "string",
12	"created_by_user_id": "string"
13	}