AI evals

Turn support tickets into eval dataset rows

Calibre Labs' ticket-to-eval skill takes a customer support ticket, complaint or raw AI trace and removes personal details before anything else. It then writes two eval rows: a regression row that stays near the original wording and is tagged with what went wrong, and a broader row that generalizes the case. It can write to local CSV files or to an eval platform.