Define how responses should be annotated
continuous
(e.g. from 1-10) and categorical
(e.g. “good”, “neutral”, “bad”) annotations.
While continuous annotations require you to define a minimum and maximum value, categorical annotations require you to define a list of possible labels with associated scores.
You can define a criterion from the Annotation page or on any detailed logs page.
Create New Criterion
button on the top right of the page.
After creating a criterion you can update its description, and min./max. values or mapping of categorical values to scores.
Annotate
button on the top right of the trace log viewer.Edit
button next to the Annotations
section in the sidebar.
In the popover, you can either search for an existing annotation with the search bar or create a new one by clicking on the Add
button.
Below you can see how a categorical annotation criteria is created.