Judge sampling

How much live traffic the judge model sees: the share of chats judged, the criteria, the judge model, and whether every thumbs down is judged too. It says what that costs a day and how small a drop it can see within a day. shouldJudge samples by chat id so every server agrees, inside an AI SDK onFinish.

Loading preview
Loading install details

Related components

From $149

One license. 1,800+ files.

shadcn
shadcn
Verified account

@shadcn

aisdkagents Looks amazing. A registry of agents makes so much sense. I like this distribution method.