evaluate( )

Pattern

Jev Best-of-N Judge

Three prepared replies sit on the table. A Jev choice lifts the winner only when its probability clears 0.70.

BeginnerSep 2026View the full pattern on desktop
Jev Best-of-N Judge preview

Problems solved

  • Pick among prepared replies with a choice question
  • Use the replies themselves as the choice criteria
  • Leave every reply on the table when the selected probability is too close

Use cases

  • Best-of-N answer selection
  • Refusing a toss-up instead of auto-shipping
  • Teaching a choice question over a closed reply set

AI SDK APIs

experimental_evaluate

Tags

jevevaluationtyped-decisionschoicebest-of-nai-sdk

Requirements

Node.js
24+
Memory
256MB
Other
  • Vercel AI Gateway API key

Environment variables

External services

vercel-ai-gatewayupstash

Ready to use?

View the full interactive pattern with live preview and copy the source code.

View the pattern on desktop

Related patterns

Jev Infinite FAQA FAQ whose last row is a live ask field. Jev opens a canned answer when it matches, or a short grounded answer becomes another row.Sep 2026
Jev + Web ContextExa finds live evidence, Jev answers the same question with and without it, and leave-one-out weights show what each source changed.Sep 2026
Jev Confidence RouterFour trays are on the table. A message flies to a team only when confidence and the selected probability both clear their floors.
Jev Sub-agent DelegationPick one specialist with a Jev choice, then run only that agent when confidence and selected probability both clear their floors.Sep 2026