Evaluation & Optimization

Pattern

Evaluator-Optimizer Pattern

Improve output quality with dual agents. Evaluator analyzes quality while optimizer refines results through iterative feedback.

AdvancedOct 2025View the full pattern on desktop
Evaluator-Optimizer Pattern preview

Problems solved

  • Evaluate draft quality with a dedicated evaluator tool
  • Optimize content iteratively from evaluation feedback
  • Loop evaluator and optimizer tools under one orchestrator agent
  • Stop once quality thresholds or step limits are reached

Use cases

  • Marketing copy optimization loops
  • Technical documentation review agents
  • Translation quality control workflows
  • Creative writing refinement assistants

AI SDK APIs

new Agenttool(stepCountIsExperimental_Agenttools:gatewayInferAgentUIMessagevalidateUIMessages

Tags

aiagentsorchestratorevaluatoroptimizerquality-assurancecontent-optimizationai-sdk-v5streamingerror-recoverytool-coordination

Requirements

Node.js
24+
Memory
1GB
Other
  • OpenAI API key

Environment variables

External services

openai

Ready to use?

View the full interactive pattern with live preview and copy the source code.

View the pattern on desktop

Related patterns

Orchestrator-Worker PatternCoordinate multiple worker agents for project management. Handles task distribution, progress tracking, and result synthesis.Oct 2025
Multi-Step Tool PatternExecute multi-step workflows with typed tools. Includes streaming, tool chaining, and decision-making for automated tasks.Oct 2025
HIL Needs ApprovalDemonstrate tool approval with async generators. Includes real-time feedback, approval workflows, and interactive management.Oct 2025
HIL Inquire Multiple ChoiceGather information through AI-driven multiple choice questions. Includes approval workflows and real-time rendering.Oct 2025