For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
DashboardWebsiteCommunity
DocsAPI ReferenceChangelog
DocsAPI ReferenceChangelog
  • API Reference
      • GETList TaskAgent Eval Sets
      • POSTCreate TaskAgent Eval Set
      • GETGet TaskAgent Eval Set
      • POSTUpdate TaskAgent Eval Set
      • DELDelete TaskAgent Eval Set
      • GETList TaskAgent Eval Runs
      • POSTStart TaskAgent Eval Run
      • GETGet TaskAgent Eval Run
  • External Links
    • Agent API Docs
    • OpenAPI Spec
LogoLogo
DashboardWebsiteCommunity
API ReferenceTask Agent Evals

Create TaskAgent Eval Set

POST
/org/:org_id/project/:project_id/task-agent/:task_agent_id/eval/set
POST
/api/v1/org/:org_id/project/:project_id/task-agent/:task_agent_id/eval/set
$curl -X POST https://app.rightbrain.ai/api/v1/org/org_id/project/project_id/task-agent/task_agent_id/eval/set \
>     -H "Authorization: Bearer <token>" \
>     -H "Content-Type: application/json" \
>     -d '{
>  "name": "Support quality golden set",
>  "task_agent_run_ids": [
>    "0190b234-1111-2222-3333-444444444444",
>    "0190b234-5555-6666-7777-888888888888"
>  ],
>  "description": "Reference conversations for support triage."
>}'
1{
2  "id": "string",
3  "name": "string",
4  "task_agent_id": "string",
5  "project_id": "string",
6  "created": "string",
7  "modified": "string",
8  "task_agent_run_ids": [
9    "string"
10  ],
11  "description": "string",
12  "created_by_user_id": "string"
13}
Create a reusable TaskAgent eval set from completed, replayable TaskAgent runs. Reference inputs and outputs are snapshotted for stable future evals but are not exposed in this API version.
Was this page helpful?
Previous

Get TaskAgent Eval Set

Next
Built with

Authentication

AuthorizationBearer

Bearer token authentication using JWT tokens from Ory Kratos/Hydra

Path parameters

org_idstringRequiredformat: "uuid"
The organization ID
project_idstringRequiredformat: "uuid"
The project ID
task_agent_idstringRequiredformat: "uuid"
The task agent ID

Request

This endpoint expects an object.
namestringRequired1-64 characters
task_agent_run_idslist of stringsRequired
descriptionstring or nullOptional<=256 characters

Response

Successful Response
idstringformat: "uuid"
namestring
task_agent_idstringformat: "uuid"
project_idstringformat: "uuid"
createdstring
modifiedstring
task_agent_run_idslist of stringsRead-only
descriptionstring or null
created_by_user_idstring or nullformat: "uuid"

Errors

400
Bad Request Error
403
Forbidden Error
404
Not Found Error
422
Unprocessable Entity Error