ganbo-gab/open-storyboard-canvas

Open Storyboard Canvas – What It Is

Open Storyboard Canvas is a desktop application that lets creators build, manage and run AI‑powered image‑ and video‑generation workflows on a visual “canvas”. It combines a node‑based editor, a 3‑D “director studio”, and an AI “Agent” that can be chatted with to create or edit assets. The whole tool runs locally (macOS & Windows) using Tauri 2, React, TypeScript and Rust.

---

Core Features (as described in the README)

Feature	What It Does
Canvas Agent (beta)	Chat on the right‑hand side; the Agent can read the current project, selected node and attached media, then create, move, edit nodes, submit generation jobs, track their status and show concise logs.
AI image / video workflow	Supports generation from scratch, reference‑image editing, video creation and storyboard‑derived outputs. Multiple providers (OpenAI‑compatible, Agnes, Dreamina CLI, etc.) can be configured, with per‑task settings for model, resolution, aspect, length, etc.
Node‑based canvas & tag groups	Upload media, AI‑generated images/video, storyboards, panoramas, director‑studio scenes as nodes. Tag groups act as containers to keep references tidy without affecting prompt text.
Director Studio & panoramas	3‑D scene where you place characters, props, lights and cameras. You can record the scene, export a screenshot back to the canvas, or import a generated panorama as the background.
Productivity & diagnostics	Bulk import of prompts via spreadsheet, prompt libraries, undo/redo, automatic project persistence, searchable sanitized logs, and detailed error reports.
Cross‑platform desktop app	Packaged for macOS (universal) and Windows (x64). Uses Tauri 2 for the native wrapper, React for UI, and Rust for system‑level commands and AI‑provider adapters.

---

Who Might Use It?

• Storyboard artists & animators who want AI‑generated concept images or short video clips directly inside their planning board.
• Content creators (games, marketing, film) needing a quick way to prototype visuals with multiple AI models without leaving a single interface.
• Developers who want a locally‑run, extensible platform to plug in new AI providers or custom CLI tools (e.g., Dreamina).

---

How to Get Started

1. Download the installer from the latest GitHub Release (Windows .exe or macOS .dmg).
2. Configure providers under Settings → My Config – add API keys for text, image or video models, or point to a local Dreamina CLI.
3. Create a new canvas project and add nodes (upload media, AI‑image, AI‑video, director‑studio, tag groups).
4. Generate: either click the node’s generate button or invoke the right‑hand Agent to let it handle creation, moving, and monitoring of tasks.
5. Inspect results: generated assets appear as new nodes; logs on the left give a readable summary and a link to the raw (sanitized) API response.

---

Technical Stack (from the repo)

• Frontend: React + TypeScript, Zustand for state, i18n for Chinese/English UI.
• Backend / native bridge: Rust (src‑tauri) exposing commands to the frontend via Tauri.
• AI integration: Provider adapters in src-tauri/src/ai/ handling OpenAI‑compatible APIs, Agnes, Dreamina CLI, and custom declarative providers.
• Persistence: Project files, node graph, viewport, history and media references stored locally; credentials are kept separate and are not exported by default.

---

Development Quick‑Start (as per README)

# clone and install
git clone https://github.com/ganbo-gab/open-storyboard-canvas.git
cd open-storyboard-canvas
npm install

# run UI only
npm run dev

# run full desktop app (requires Tauri deps)
npm run tauri dev

The repo also includes linting, TypeScript type‑checking, Rust formatting and tests.

---

License & Origin

• Forked from Storyboard‑Copilot (author henjicc) with explicit permission.
• New code is released under the MIT License.

---

Bottom Line

Open Storyboard Canvas is a genuine, locally‑run AI‑assisted creative canvas that blends node‑based storyboarding, multimodal generation, and an interactive chat‑Agent. It is squarely in the AI‑creative‑tool space rather than a simple tutorial or link collection.