ChrisChen667788/wind-comic
Multi-agent AI pipeline that turns one line of text into a finished short-form drama: script, cinematic storyboards, character-consistent video. Provider-agnostic (OpenAI/Claude, MJ, Minimax, Veo/Sora, fal, ComfyUI). MIT.
What it solves
Wind Comic is a multi-agent AI studio designed to transform a single line of text into a complete, finished short-form drama. It eliminates the need to manually stitch together fragmented AI video clips by automating the entire production pipeline—including scriptwriting, character design, storyboarding, voiceover, and final video editing—into a one-stop workflow.
How it works
The system operates as a multi-agent pipeline where specialized AI roles (Writer, Director, Producer, Character Designer, Storyboard Artist, etc.) hand off tasks using strict consistency contracts. The process flows from text to JSON, then to images, and finally to MP4 files. Key technical features include:
- Multi-Engine Orchestration: It integrates with over 12 media engines (such as Kling, MiniMax, and Veo) and supports a "multi-engine race" where the first high-quality clip wins.
- Director's Control Room: A visual interface for placing actors and cameras on a top-down stage to generate precise staging directives and layout sketches.
- Quality Loops: An automated "Vision-Audit" retry loop that regenerates shots scoring below 70, and a health report system for aspect ratio, duration, and bitrate.
- Lip-Sync Pipeline: A process that converts TTS audio into viseme keyframe tracks, aligns them, and renders them via pluggable engines (like wav2lip or SadTalker).
- Real-time Collaboration: A multiplayer timeline powered by Yjs CRDT for team editing.
Who it’s for
It is built for content creators, filmmakers, and marketers who want to produce high-quality short-form cinematic content or commercial ads without manually managing multiple AI tools.
Highlights
- End-to-End Production: Generates script, cast, storyboards, voiceover, and final MP4 from one prompt.
- Character Consistency: Features a Character Studio with "DNA identity lock" and reusable characters across projects.
- Advanced Directing Tools: Includes a Director's console for precise blocking and a segment retake feature to edit specific frames without re-rendering the whole shot.
- Commercial Ad Factory: Specialized tools for e-commerce ads, including automated brief generation from URLs, A/B testing for hooks, and compliance filtering for advertising laws.
- BYO LLM: Supports bringing your own LLM providers via environment variables with zero code changes.
Related
- Project
- Project
- Project
- Project
- Project