PatternsTools & Utilities

Cloudflare Markdown.new Web Scraper

Convert any webpage to markdown using Cloudflare's markdown.new. Clean, structured output for AI pipelines and content processing.

Loading preview…

Problems solved

Technical challenges this implementation handles out of the box.

Products and workflows this pattern is designed to support.

Requirements, wiring steps, and what this pattern adds to your project.

Pick how you want to pull this pattern in — then wire env vars and routes the same way.

1
Install from the preview toolbar
Copy the install command above and run it in your project — Pro patterns include a short-lived token.
2
Customize the agent and tool files
Adapt prompts, tools, and stop conditions for your product — Copy for AI in the toolbar helps seed that work.
3
Run your dev server and open the pattern route
Install dependencies if needed, then start the app and verify responses.

External services

cloudflare

3 files

16 total

npm packages

Upstashlucide-reactNext.jsReactsonnerstreamdownZod

Registry components

alertbadgebuttoncardinputscroll-areaskeletontabstooltip

lib/scraper.ts
Core scraping engine using Cloudflare markdown.new: fetches via https://markdown.new/<url>, parses response to extract title, URL source, and markdown content.
lib/actions.ts
Server action entry point: URL validation with Zod, rate limiting, and orchestration of the markdown.new scraping pipeline.