xixihhhh/clipforge

ClipForge – Open‑source AI short‑video generator for e‑commerce

What it is – ClipForge (formerly daihuo‑jianshou) is a web‑based, open‑source application that turns a single product image (or a short text prompt) into a ready‑to‑publish, vertical short video for platforms such as Douyin, Kuaishou, Xiaohongshu, WeChat Channels, TikTok Shop, Reels, etc. The whole pipeline – script writing, storyboard generation, image‑to‑video synthesis, text‑to‑speech, subtitles, background music, and final FFmpeg stitching – is orchestrated automatically, with optional “director” mode for fine‑grained control.

---

Core capabilities (as described in the README)

Feature	What you get
One‑click product video	Upload a product photo → AI extracts selling points → writes multiple scripts → locks the original product image (no deformation) → selects or generates B‑roll → TTS + subtitles + BGM → 30‑second video ready for upload.
Two production tracks	Free track uses only public CC image/video assets and free Edge TTS (no API keys, zero cost). AI track uses paid generative models (e.g., Seedance 2.5, GPT‑Image 2) and charges per second of generated content.
Director vs. Beginner mode	Beginner mode is fully automated. Director mode exposes storyboard, camera‑move presets, look presets, model selection, cost preview, and per‑shot editing.
Cross‑shot consistency	The system keeps the same character, product, lighting, and composition across shots by feeding generated key‑frames back into the model as anchors.
Selective re‑generation	If a single shot is unsatisfactory, only that segment is re‑run; the rest of the video stays untouched.
Integrated quality gate	Four “judge” LLMs (pace, language, creativity, structure) critique each draft script, rewrite it to a fixed length, and only then allow video generation.
Template library	391 ready‑made e‑commerce templates (e.g., “factory tour”, “explosive literature”, “egg‑drop test”). Templates can be customized, exported as JSON, or forked.
Hot‑topic auto‑generation	Real‑time Douyin hot‑search list (fallback to Google Trends) feeds one‑sentence prompts that instantly produce a video variant.
Batch production	Upload many products, pick a template, and generate dozens of videos in a single run.
Compliance suite	Automatic AIGC labeling (visible overlay + hidden metadata), ad‑law prohibited‑word scanning, QR‑code export checks, and platform‑specific publishing guards are enabled by default.
Agent/CLI integration	Exposes a REST‑style MCP server, a CLI (bin/clipforge.mjs), and a Skills plugin that can be called from AI agents (Claude, Cursor, etc.).
Local‑first & open‑source	Built with Next.js 16, React 19, TypeScript 5, Tailwind 4, and FFmpeg. Licensed under AGPL‑3.0, all data stays on the host machine unless you explicitly use a paid cloud model.

---

Typical workflow (quick‑start example from the README)

# Run the pre‑built Docker image (data persisted in a volume)
docker run -d -p 3000:3000 -v clipforge-data:/data ghcr.io/xixihhhh/clipforge

# Open a browser → http://localhost:3000
# 1️⃣ Upload a product picture or paste a product URL.
# 2️⃣ Choose Free (no key) or AI generation.
# 3️⃣ Pick a selling style / template.
# 4️⃣ Let the judges rewrite the script, then generate a 9‑grid storyboard.
# 5️⃣ One‑click “Compose” – FFmpeg merges generated frames, TTS, subtitles, BGM.
# 6️⃣ Download the vertical video ready for Douyin/ TikTok etc.

The README also provides a step‑by‑step tutorial (TUTORIAL.md / TUTORIAL.en.md) for non‑technical users.

---

Who might use it?

User	Why ClipForge helps
Small e‑commerce sellers	Produce dozens of product videos per day without a camera crew or a video editor.
Marketing teams	Rapidly test multiple hooks, subtitles, and music variants (A/B) at near‑zero marginal cost.
Content creators / Influencers	Generate faceless “UGC‑style” ads that comply with Chinese platform regulations.
Developers / AI researchers	Open‑source codebase to experiment with multi‑model pipelines (image‑to‑image, text‑to‑speech, video synthesis) and integrate with custom agents.

---

License & community

• License: AGPL‑v3 (source‑available, must share modifications when deployed as a service).
• Repository activity: CI badge present, documentation includes changelog, issue references, and a roadmap section.
• Related projects: The author also maintains Dramake, an AI short‑drama skill that shares the same model‑aggregation backend.

---

Bottom line

ClipForge is a genuine, full‑stack AI video generation platform focused on short‑form e‑commerce ads. It combines script generation, multi‑model image/video synthesis, TTS, compliance checks, and batch/export tools into a single open‑source product that can be run locally for free or hooked into paid generative models when higher quality is needed.