Dataset from Trace

​

Create a dataset from a trace

When viewing a trace, you can create a test case from any span that has inputs by clicking the Add to dataset button.

Test cases are pre-defined datasets of inputs for prompt templates with the option to add a target (ground truth) and tags for each case. You can use these test cases in the playground to test your prompts. Learn more about test cases.

The modal will pre-populate with the data from the span.

• The trace inputs will be mapped to key-value pairs. You can edit, delete, or add your own inputs as needed.
• The output field will be pre-populated as an optional target. You can edit or delete this as needed.
• Any tags will also be populated. You can edit or delete these as needed.

If there are any existing datasets with the same input keys, you can add the new case to that dataset. Otherwise, you can click the + button to create a new dataset.

Datasets can be viewed/edited from the Datasets page. And, in the Playground, you can load test cases for prompt testing.