jianjieyiban/JJYB_AI_VideoAutoCut

What it solves

JJYB AI VideoAutoCut is a local-first AI video creation workstation designed to eliminate the friction of switching between multiple tools during the video production process. It streamlines the entire workflow from raw material analysis and scriptwriting to voiceover generation, audio-visual synchronization, and final export.

How it works

The project integrates several AI-driven engines and tools into a single desktop application (Flask + PyWebView):

• Original Commentary Workflow: Uses SmartShotSegmenter (via TransNetV2 or OpenCV) for scene detection, LLMs/VLMs for script generation in various styles, and a PuppetSyncEngine to align video clips with generated audio without using fake freeze-frames.
• Smart Remixing: Offers a general mode based on clip scoring and a music-beat mode using librosa to synchronize cuts to the BGM's rhythm.
• AI Voiceover & Cloning: Supports multiple TTS engines (Edge TTS, Azure, etc.) and local voice cloning via an IndexTTS2 worker.
• AI Cover Generation: Connects to various image generation APIs (DALL-E 3, etc.) to create video thumbnails.
• Integration: Renders via FFmpeg and allows one-click export to CapCut (剪映) native draft formats for further manual polishing.

Who it’s for

Video creators and content producers who want to automate the tedious parts of the video editing process—such as scene splitting, scriptwriting, and audio-visual syncing—while maintaining local control over their data.

Highlights

• End-to-End Workflow: Covers everything from material analysis to final export in one tool.
• Human-like Syncing: A dedicated engine that matches clips to audio based on real timelines rather than simple padding.
• CapCut Integration: Exports native drafts including video, audio, BGM, and subtitle tracks.
• Extensive Style Presets: Includes 12 narrative styles and writing personas to tailor the tone of the AI-generated scripts.
• Local-First Approach: Prioritizes local processing and storage using SQLite and local AI workers for privacy and speed.