Premium skill

Build evals around your real AI SDK agent

Adds datasets, deterministic tests, model-graded scorers, and local or CI commands around an existing TypeScript or JavaScript AI SDK agent. Live model runs are opt-in.

Install with Premium View pricing

Plan: Premium
Access: Gated
Install: Tokenized
Authored files: 8

Install with skills CLIPremium skills install through a short-lived private link.

$ npx skills add … --skill build-ai-sdk-agent-evals

Open Premium install

Filesystem

Browse the authored file tree — tools, references, and evals included. Source unlocks with Premium.

SKILL.mdmarkdown

Unlock skill source

Browse every authored SKILL.md with premium.

Install with Premium

File tree for build-ai-sdk-agent-evals stays visible so you can see the pack before unlocking.

File

What you get

Runnable behavioral contract

Datasets, harnesses, deterministic tests, and live evals that exercise the real agent boundary.

Safe tool trajectories

Approval, denial, tenancy, exit conditions, and destructive tools protected with fakes and hard gates.

Fair prompt and model comparisons

Shared cases, calibrated scorers, metadata, variance, and budgets for decisions that survive reruns.

Local and CI thresholds

Separate offline, live smoke, and full tiers for quality, cost, latency, and regression checks.

One predictable workflow

The skill extends repository conventions and grounds every version-sensitive API in installed types and first-party docs.

Inspect the installed AI SDK, agent boundary, tests, data, and CI.
Turn intended behavior and risks into measurable cases and scorers.
Implement deterministic coverage first, then controlled live evals.
Run, classify, calibrate, and leave exact local and CI commands.

Move from “seems to work” to measured behavior

Available with Premium. The private install link expires; the downloaded skill does not. Generate a fresh link when you want to update it.