Create test case datasets and benchmarks
Inputs
: prompt variable values that are interpolated into the prompt template of your model config at generation time (i.e., they replace the {{ variables }}
you define in the prompt template.Target
: Represents the expected or intended output of the model.Tags
: Any string metadata tags you want to attach to a test case.Upload file to create dataset
. In the following modal, provide a name for your
dataset and upload your file.
question
.
target
and tags
are reserved.
If a target
column is present, it will be used as the gold standard answer for that row’s output.
For example, in the CSV below, the target 4
is the expected answer to the question What is 2 + 2
.
tags
column is present, it will be used as metadata tags for a specific row. Tags should be comma-separated with no spaces.
For example, in the CSV below, row one has been tagged as easy
and arithmetic
, and the second row hard
and calculus
.
Add test case
, you can optionally select Upload new dataset
to upload a CSV file.
Sample Output File