Loading pattern preview
TemplatesArtifacts
JSON Render Remotion
JSON Render Remotion
AI-generated video from natural language using @json-render/remotion. Describe a video and watch it stream in as a timeline spec, then render in a Remotion Player.
Loading pattern preview
Problems solved
Technical challenges this implementation handles out of the box.
- Generate Remotion video timelines from natural language
- Stream timeline specs into a Remotion Player preview
- Compose scenes with cataloged components, transitions, and effects
Use cases
Products and workflows this pattern is designed to support.
- Product intro videos
- Photo slideshow generators
- Testimonial video drafts
- Prompt-to-Remotion prototyping
Setup
Requirements, wiring steps, and what this pattern adds to your project.
Getting started
Pick how you want to pull this pattern in. Then wire env vars and routes the same way.
- 1
Download → Next.js app
Use Download → Next.js app in the preview toolbar. You get a zip scaffold (Pro downloads rewrite preview `/view/.../api/*` paths to `/api/*` automatically).
- 2
Extract the zip and install dependencies
Unzip the archive, then run `pnpm install` (or npm / yarn) in the project folder.
- 3
Fill .env.local
The download includes .env.local placeholders when needed. Add real values for: AI_GATEWAY_API_KEY, AI_GATEWAY_MODEL.
- 4
Customize the agent and tool files
Adapt prompts, tools, and stop conditions in the generated project for your product.
- 5
Run the app and open the pattern route
Run `pnpm dev`, open the setup/checklist page if present, then navigate to the generated pattern route and verify responses.
Environment variables
Capabilities
AI SDK APIs
streamTextgatewayProviders
Claude
External services
Upstash
Files added
12 filesapp/page.tsxapp/page-client.tsxapp/layout.tsxapp/api/generate/route.tscomponents/json-render-remotion-demo.tsxcomponents/empty-state.tsxlib/catalog.tslib/custom-components.tsxlib/geist-pixel-square-base64.tslib/rate-limit.tslib/remotion-theme-context.tsxREADME.md
Dependencies
16 totalnpm packages
10@json-render/core@json-render/remotion@remotion/playerUpstashAISDKlucide-reactNext.jsReactremotionZod
Registry components
buttonemptyinputresizablescroll-areatextarea
Critical files
lib/catalog.tsVideo catalog using defineCatalog with Remotion schema and standard component/transition/effect definitions. Exports getVideoPrompt() for API.
lib/custom-components.tsxRemotion component registry (customComponents) passed to Renderer. Includes GradientBackground, CountUp, and other custom scene components.
generate/route.tsStreaming API for video generation. Uses streamText with getVideoPrompt() as system prompt. Returns toTextStreamResponse() for JSONL.
Requirements
- Complexity
- Advanced
- Setup time
- ~5 minutes
- Node
- 24+
- Memory
- 256MB
Upstash Redis
