Loading pattern preview
TemplatesAgent Patterns
Evaluator-Optimizer Pattern
Evaluator-Optimizer Pattern
Improve output quality with dual agents. Evaluator analyzes quality while optimizer refines results through iterative feedback.
Loading pattern preview
Problems solved
Technical challenges this implementation handles out of the box.
- Evaluate draft quality with a dedicated evaluator tool
- Optimize content iteratively from evaluation feedback
- Loop evaluator and optimizer tools under one orchestrator agent
- Stop once quality thresholds or step limits are reached
Use cases
Products and workflows this pattern is designed to support.
- Marketing copy optimization loops
- Technical documentation review agents
- Translation quality control workflows
- Creative writing refinement assistants
Setup
Requirements, wiring steps, and what this pattern adds to your project.
Getting started
Pick how you want to pull this pattern in. Then wire env vars and routes the same way.
- 1
Download → Next.js app
Use Download → Next.js app in the preview toolbar. You get a zip scaffold (Pro downloads rewrite preview `/view/.../api/*` paths to `/api/*` automatically).
- 2
Extract the zip and install dependencies
Unzip the archive, then run `pnpm install` (or npm / yarn) in the project folder.
- 3
Fill .env.local
The download includes .env.local placeholders when needed. Add real values for: OPENAI_API_KEY.
- 4
Customize the agent and tool files
Adapt prompts, tools, and stop conditions in the generated project for your product.
- 5
Run the app and open the pattern route
Run `pnpm dev`, open the setup/checklist page if present, then navigate to the generated pattern route and verify responses.
Environment variables
OPENAI_API_KEYGet key
Capabilities
AI SDK APIs
AgenttoolstepCountIsExperimental_AgentgatewayProviders
OpenAI
Files added
14 filesapp/page.tsxapp/layout.tsxapp/api/evaluator-optimizer/route.tslib/multi-agent-orchestrator.tslib/multi-agent-tool-types.tslib/ai-agent-evaluator-optimizer-tools/evaluator.tslib/ai-agent-evaluator-optimizer-tools/optimizer.tslib/ai-agent-evaluator-optimizer-tools/schema.tslib/ai-agent-evaluator-optimizer-tools/communication.tscomponents/evaluator-optimizer-chat.tsxcomponents/tool-views/evaluator-view.tsxcomponents/tool-views/optimizer-view.tsxREADME.mdAGENT_FLOW.md
Dependencies
9 totalnpm packages
6AISDKlucide-reactNext.jsReactsonnerZod
Registry components
buttoncollapsibleempty
Critical files
lib/multi-agent-orchestrator.tsCore orchestrator agent definition using Experimental_Agent. Configures the evaluator-optimizer coordination loop with model, instructions, tools, and stepCountIs(15) stop condition.
ai-agent-evaluator-optimizer-tools/evaluator.tsEvaluator tool that assesses content quality against criteria. Uses generator pattern to yield loading/ready states. Returns quality scores, issues, suggestions, and threshold checks.
ai-agent-evaluator-optimizer-tools/optimizer.tsOptimizer tool that takes evaluation feedback and iteratively improves content. Uses generator pattern for streaming state transitions.
ai-agent-evaluator-optimizer-tools/communication.tsInter-agent communication tools (sendEvaluation, requestEvaluation, sendOptimization) that enable the evaluator-optimizer message passing loop.
ai-agent-evaluator-optimizer-tools/schema.tsShared Zod schemas (EvaluationResult, OptimizationParams, OptimizationResult, EvaluationCriteria) defining data contracts between evaluator and optimizer agents.
Requirements
- Complexity
- Advanced
- Setup time
- ~15 minutes
- Node
- 24+
- Memory
- 1GB
