Loading pattern preview
TemplatesTools & Utilities
Firecrawl Scrape Tool Chat
Firecrawl Scrape Tool Chat
Crawl and extract content using Firecrawl's API. Includes URL processing, markdown conversion, and structured data extraction.
Loading pattern preview
Problems solved
Technical challenges this implementation handles out of the box.
- Search and scrape pages with Firecrawl's API
- Convert crawled pages into markdown for the model
- Transform Firecrawl hits into structured tool results
Use cases
Products and workflows this pattern is designed to support.
- Web research agents that need full page text
- Competitive site monitoring
- Content extraction chat tools
- SEO research that starts from Firecrawl search
Setup
Requirements, wiring steps, and what this pattern adds to your project.
Getting started
Pick how you want to pull this pattern in. Then wire env vars and routes the same way.
- 1
Download → Next.js app
Use Download → Next.js app in the preview toolbar. You get a zip scaffold (Pro downloads rewrite preview `/view/.../api/*` paths to `/api/*` automatically).
- 2
Extract the zip and install dependencies
Unzip the archive, then run `pnpm install` (or npm / yarn) in the project folder.
- 3
Fill .env.local
The download includes .env.local placeholders when needed. Add real values for: FIRECRAWL_API_KEY.
- 4
Customize the agent and tool files
Adapt prompts, tools, and stop conditions in the generated project for your product.
- 5
Run the app and open the pattern route
Run `pnpm dev`, open the setup/checklist page if present, then navigate to the generated pattern route and verify responses.
Environment variables
FIRECRAWL_API_KEYGet key
Capabilities
AI SDK APIs
streamTexttoolstepCountIsconvertToModelMessagesProviders
Claude
External services
Firecrawl
Files added
7 filesapp/page.tsxapp/layout.tsxapp/api/websearch-firecrawl/route.tscomponents/websearch-demo.tsxlib/websearch-firecrawl-tool.tslib/request-utils.tsREADME.md
Dependencies
8 totalnpm packages
7AISDK@mendable/firecrawl-jslucide-reactNext.jsReactsonnerZod
Registry components
empty
Critical files
lib/websearch-firecrawl-tool.tsCustom Firecrawl web search tool using @mendable/firecrawl-js SDK. Implements app.search() with markdown format scraping and structured output transformation.
websearch-firecrawl/route.tsAPI route wiring the custom Firecrawl tool with streamText. Shows stepCountIs(3) for tool call limiting.
Requirements
- Complexity
- Intermediate
- Setup time
- ~10 minutes
- Node
- 24+
- Memory
- 512MB
Upstash Redis for rate limiting
