diffusionstudio/editor
The VS Code of video editing, built for agents.
What it solves
Diffusion Studio turns AI agents into professional video editors. It bridges the gap between AI-generated scripts or instructions and the technical requirements of video production, allowing users to automate tasks like cutting clips, removing filler words, adding subtitles, and creating motion graphics.
How it works
It uses a "compositions-as-code" approach where video projects are defined as JSX files. The desktop application acts as a visual editor that renders these files, while simultaneously exposing an MCP (Model Context Protocol) server. This allows AI agents (like Claude Code or Cursor) to "see" and "hear" media through specialized CLI tools—such as diffusion transcribe or diffusion listen—and manipulate the video timeline by writing directly to the project's code. Changes made in the UI are reflected in the code, and vice versa.
Who it’s for
This project is for developers and power users who want to automate video editing workflows using AI agents. It is ideal for those who prefer managing video projects through code or natural language prompts while retaining the ability to manually refine the output in a professional-grade visual editor.
Highlights
- Bidirectional Editing: Changes made in the visual editor are saved as code, and code updates are instantly reflected in the visual canvas.
- Agent-Ready Tools: Includes a suite of CLI commands for media inspection, including transcription, waveform analysis, and frame grabbing, designed for AI agents to process raw footage.
- Code-Based Compositions: Uses a JSX-based authoring API, making video projects version-controllable and programmatically editable.
- Headless Support: The runtime can operate without a UI, enabling automated rendering pipelines for large-scale video generation.
Related
- Project
naqashafzal/AI-Content-StudioAI Content Studio is an open‑source platform that automates the whole video‑creation workflow. A supervisory set of AI agents researches a topic, writes and QA‑checks a script, then a multimodal pipeline (Whisper transcription, OpenCV scene analysis, FFmpeg processing) produces a fully‑styled, loudness‑normalized video with captions, B‑roll and branding. It supports style‑cloning from reference clips, Urdu TTS, and 24/7 auto‑pilot campaigns, and runs via a FastAPI backend + Next.js UI.
- Project
AkshitIreddy/AI-Powered-Video-Tutorial-GeneratorAI‑Powered Video Tutorial Generator is a Windows‑only desktop app that turns a question or topic into a fully editable video lesson. It handles research, script writing, storyboard creation, narration, illustration, presenter animation and final export, using either local diffusion models (ComfyUI/SDXL) or cloud LLM/image providers. The open‑source stack combines a React/Tauri UI, a Rust core, and a Python pipeline, and it ships with bundled runtimes (Python, Node, Chromium, FFmpeg).
- Project
RoseKhlifa/Image-StudioImage Studio is an open‑source, cross‑platform desktop client (Windows/macOS/Linux/Android) built with Go + React (Wails) that lets you generate and edit images via any OpenAI‑compatible API. It supports streaming responses over SSE or WebSocket to avoid proxy timeouts, works with the standard Images API, offers batch img2img, custom aspect ratios, and integrates with a prompt‑import helper. Configuration is manual (base URL, API key, model ID) and the project is AGPL‑v3 licensed.
- Project
modelscope/DiffSynth-StudioDiffSynth‑Studio is an open‑source diffusion‑model engine that unifies inference, low‑VRAM management, quantisation, and LoRA‑style training for image, video, and audio generative models. It supports many state‑of‑the‑art models, offers VRAM‑saving tricks (disk‑/CPU‑offload, NF4/INT8/EntroPack quantisation), and ships companion UI tools (ComfyUI, WebUI). Ideal for researchers and developers who need a single framework to run or fine‑tune large diffusion models on consumer GPUs.
- Dispatch