NomaDamas/CozyClay

Open source previs software in the browser: block a scene, pose characters, author camera moves and cuts, then take the same shots to an AI video model.

What it solves

CozyClay is a browser-based previs (pre-visualization) studio that allows creators to block scenes, pose characters, and plan camera movements on a timeline. It bridges the gap between 3D layout and AI video generation by providing a structured workspace to create the visual foundations (first frames, reference clips, and prompts) needed to guide AI video models like Seedance, Kling, and Veo.

How it works

Built with Three.js and React Three Fiber, the studio provides a 3D environment where users can stage scenes with primitives and set pieces. It includes a timeline for cutting shots and drawing dolly rails for camera movement.

For motion, it integrates with the Kimodo bridge to generate character movement from prompts or capture motion from video/photos using GVHMR. The project also features an MCP (Model Context Protocol) server, allowing AI assistants like Claude to directly manipulate the scene, place characters, and frame shots using natural language.

Who it’s for

Filmmakers, animators, and AI video artists who need precise control over composition, blocking, and motion before exporting assets to AI video generation models.

Highlights

  • AI-Driven Control: Supports MCP for direct scene manipulation via AI assistants and an integrated Agent panel for ChatGPT.
  • AI Video Export: Generates keyframe packs, depth/normal passes, and structured prompts tailored for specific AI video models.
  • Motion Generation: Integrates with Kimodo for prompt-based motion and GVHMR for video-to-motion capture.
  • Browser-Based Workflow: Fully functional in a browser tab with a quick npx install, including a built-in camera tutorial.
  • Workflow Canvas: A node-based editor for building prompts and running video generation via ComfyUI or fal.

Related

  • Project
    open-ribbi/velocut

    A browser-based studio that combines multitrack video editing and 3D scene direction with AI integration for automated scene composition and editing.

  • Project
    visualbruno/3DGenStudio

    3D Gen Studio is an open‑source, AI‑driven desktop/web app that lets you build 3‑D assets end‑to‑end. It combines a Kanban board or node‑graph UI with ComfyUI workflows and external 3‑D generation APIs, offering image‑to‑mesh pipelines, auto‑UV/retopo, AI‑auto‑rigging (SkinTokens + optional Kimodo motion), LOD/optimization, and game‑ready checks—all stored locally on disk.

  • Project
    coze-dev/coze-studio

    Coze Studio is an open-source, low-code visual development platform for creating, debugging, and deploying AI agents, workflows, and AI apps.

  • Project
    dramaclaw/dramaclaw

    A source-available AI drama production pipeline that transforms scripts into finished films using a dual-mode workflow of a node-based canvas and a structured production pipeline.

  • Project
    suki0dayo/AI_film_studio

    A node-based visual editor that streamlines AI movie production by automating the workflow between LLMs for prompting and ComfyUI for image and video generation.