Alisa0808/vox-director

Vox Director – AI‑powered “paper‑collage” explainer videos

What it does – You give a single line topic (e.g., “Mexican street food”) and the tool automatically creates a short, Vox‑style video. The output is a fully‑rendered mp4 that includes:

• a scripted narration,
• collage‑style key‑frame posters for each beat,
• animated motion,
• background music and captions.

How it works – The pipeline is an agent skill that runs on the Atlas Cloud API and a local ffmpeg installation. The steps are:

1. Beat map – the agent proposes a narrative arc (the “beats”) and you approve it.
2. Style bake‑off – the same beat is rendered in a few visual themes; you pick the one you like.
3. Keyframe generation – each beat becomes a collage poster using the nano‑banana‑2 text‑to‑image model.
4. Animation – the poster is animated with a Gemini‑Omni‑Flash image‑to‑video model (or a specialized model for real people/brands).
5. Voice & music – narration is produced by xai/tts‑v1 (or cloned with seed‑audio‑1.0), and music comes from minimax/music‑2.6.
6. Assembly – ffmpeg concatenates the clips, mixes the audio, adds captions and a watermark, producing final.mp4.

Input variations – besides the basic “B‑roll” flow, the skill supports:

• A‑roll – you supply a talking‑head video; the system segments it into beats and restyles it into the collage look while preserving lip‑sync.
• C‑roll – you provide a single photo; the subject is cut out and placed into each collage poster.
• Host mode – a digital presenter (generated from a single image) speaks the narration inside the collage world.

Models used – All models are accessed through Atlas Cloud (the skill fetches the latest list at runtime). Key models include:

• google/nano-banana-2 for collage posters,
• google/gemini-omni-flash for generic animation,
• kwaivgi/kling-video-o3-pro for real‑person animation,
• bytedance/seedance-2.0 for presenter video,
• xai/tts-v1 for TTS, and
• minimax/music-2.6 for background music.

Installation & use – It is not a standalone program but an agent skill that any coding‑agent (Claude Code, Codex, etc.) can call. Install by cloning the repo into the agent’s skill directory or by loading the provided .skill file, then set your Atlas Cloud API key. After that, simply ask the agent to create a video with a one‑line prompt.

What’s inside the repo –

• SKILL.md/SKILL.zh.md – the workflow description for agents.
• scripts/ – individual scripts for each pipeline stage.
• references/ – prompt guides, narrative‑arc templates, voice lists, and a local‑engine description for fine‑grained motion.
• examples/ – ready‑to‑run beats.json files.
• assets/ – sample videos used in the README.

Who built it – Alisa Qian (@alisaqqt). The project is MIT‑licensed and relies on Atlas Cloud services.

---

In short, Vox Director is a turnkey AI‑driven workflow that turns a short text prompt into a polished, collage‑style explainer video, orchestrated through an agent‑friendly skill and a suite of generative models.