Agions/splicr

What it solves

splicr is a professional AI-powered video narration and commentary generation engine designed for short-form drama creators, movie reviewers, and social media storytellers. It automates the tedious process of breaking down video footage, writing engaging scripts, synthesizing cloned voices, and aligning audio with visuals, ultimately exporting a ready-to-edit project file for CapCut.

How it works

The system utilizes a Rust-native multi-agent architecture consisting of six specialized AI agents that collaborate in a pipeline:

1. Director Agent: Manages global task planning and coordinates the other agents.
2. Visual Critic Agent: Uses FFmpeg for scene detection and extracts multimodal keyframes to analyze emotional peaks.
3. Screenwriter Agent: Writes first-person monologues and "golden hooks" (the first 0-3 seconds), using a reflection loop to score potential viewer retention.
4. Voice Artist Agent: Handles voice cloning and synthesis using tools like Edge-TTS or GPT-SoVITS.
5. Sound Engineer Agent: Aligns audio and video on a 5-track timeline with millisecond precision and manages BGM ducking.
6. Quality Reviewer Agent: Scans for banned words and verifies the integrity of the final timeline before delivery.

Who it’s for

• Short-form drama creators
• Movie and TV show commentary channels
• Social media content creators focusing on storytelling

Highlights

• Native Integration: Built with Rust, Tauri 2, and React 19 for a high-performance desktop experience.
• Multi-LLM Support: Compatible with 11 major providers including Qwen, DeepSeek, OpenAI, Claude, Gemini, and local models via Ollama/LMStudio.
• Professional Export: Directly generates .draft files for native import into CapCut.
• High Precision: Features millisecond-level audio-visual alignment (deviation < 18ms).
• Voice Cloning: Supports zero-shot voice cloning for realistic narration.