Skip to main content
POST
Create evaluation dataset

Authorizations

Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Body

application/json

Request model for creating a new evaluation dataset.

dataset_name
string
required

Unique name for this dataset

Required string length: 1 - 200
queries
GroundTruthQuery · object[]
required

List of queries with ground truth relevance labels

Minimum array length: 1
description
string | null

Description of what this dataset measures

metadata
Metadata · object | null

Additional metadata

Response

Successful Response

Complete evaluation dataset with metadata.

An evaluation dataset is a collection of queries with ground truth relevance labels, used to measure retriever quality.

dataset_id
string
required

Unique dataset identifier

dataset_name
string
required

Human-readable dataset name

queries
GroundTruthQuery · object[]
required

List of queries with ground truth

created_at
string<date-time>
required

When dataset was created

updated_at
string<date-time>
required

Last update timestamp

namespace_id
string
required

Namespace this dataset belongs to

internal_id
string
required

Internal organization ID

query_count
integer
required

Number of queries in dataset

description
string | null

Dataset description

metadata
Metadata · object | null

Additional metadata (e.g., labeling instructions, version info)