Failure clusters

Where a live AI product is failing: failing chats grouped by topic, each with the share failing now against before, the topics that got worse most first. A topic opens to failing chats with the judge's reason, and becomes an eval set in one press. failureClusters folds judged chats that an AI SDK call has given a topic.

Loading preview
Loading install details

Related components

From $149

One license. 1,800+ files.

shadcn
shadcn
Verified account

@shadcn

aisdkagents Looks amazing. A registry of agents makes so much sense. I like this distribution method.