shinyobjectz/raea

Render Anything Engine: tell your AI what to make. Videos, motion graphics, 3D and games as React and TypeScript, rendered on your own GPU. Rust + Bevy, macOS, Linux and Windows.

raea — Render Anything Engine (for Anyone)

What it is. raea is a tool that turns plain instructions into finished media — videos, motion graphics, 3D scenes, and games. You describe what you want, and an AI writes the code (React and TypeScript, the languages AI models already know well). raea then renders that code on your own GPU, faster than real-time playback.

Current status. raea is in "canary" mode — it changes daily, with breaking changes and rough edges expected. It runs on macOS (Apple Silicon), Linux (x86_64), and Windows (x86_64, newest and least tested).

How it works

A "composition" is a React component that draws one frame for a given moment in time. A minimal example from the README:

import { AbsoluteFill, Composition, interpolate, registerRoot, useCurrentFrame } from "raea";

function Hello() {
  const f = useCurrentFrame();
  return <AbsoluteFill style={{ background: "#000", color: "#fff", fontSize: 120, opacity: interpolate(f, [0, 20], [0, 1]) }}>Hello</AbsoluteFill>;
}

registerRoot(() => <Composition id="hello" component={Hello} width={1920} height={1080} fps={30} durationInFrames={90} />);

Render it with one command:

raea render hello.tsx -o hello.mp4

On an Apple Silicon Mac, those 90 frames render in about a second. The same file can be played live as a game (raea play), rendered as a single frame for an AI to inspect (-o frame.png --frame 45), or checked against a quality standard (raea check hello.mp4). raea init starts a new project, and raea --help lists every available command.

What it can produce

  • Video and motion graphics — layout, text, Tailwind styling, SVG, and animation, composited on the GPU and hardware-encoded where available. raea cut trims footage based on what's spoken in it. raea check automatically catches problems before anyone watches: clipped text, low contrast, unsafe areas, freezes, and loudness issues.
  • Games — input, physics, sound, and 3D, playable live with raea play, or exported as a standalone program with raea export-game.
  • 3D scenes — written in TypeScript and rendered by the Bevy engine (version 0.20): cameras, lights, materials, glTF models, Gaussian splats, and Bevy plugins compiled into the engine.
  • Sound — a single mixer used for both live play and offline rendering, with instruments and effects, plus local models for foley (sound effects) and instrument notes (raea sao, raea tokensynth).
  • Agent-friendly output — everything raea draws stays queryable as data, so an AI can render a frame, look at it, and fix what's wrong without a human in the loop.

Using it with AI agents

  • Agent skills — the installer adds skill files to ~/.claude/skills that teach Claude Code (or any agent reading that folder) how to write, render, and check raea work. One skill covers compositions; another (raea-bevy) covers 3D and games.
  • Claude Code plugin — install via /plugin marketplace add shinyobjectz/raea, then /plugin install raea@raea.
  • Craft guides — raea guide prints the quality floor every edit must meet, plus guides for pitches, explainers, stories, games, motion, music, and layout. raea context PROJECT tells you what to read before working on a project.

Installation

macOS/Linux:

curl -fsSL https://raea.io/install | sh

This puts the raea command under ~/.raea, links it into ~/.local/bin, and adds the agent skills to ~/.claude/skills. Re-run to update. The engine is free and needs no account. Tarballs and checksums are on the releases page.

Windows 10/11 (PowerShell):

irm https://raea.io/install.ps1 | iex

This does the same under ~\.raea and adds raea to your PATH. Windows requires the Microsoft Visual C++ Redistributable (x64) and a DirectX 12 or Vulkan GPU driver.

Privacy and network behaviour

raea sends nothing on its own — no telemetry, crash reports, or update checks. Network traffic only happens when you ask for it (a remote URL in a composition, a model downloaded on first use, or a raea gen step on a provider you hold a key for). Setting RAEA_OFFLINE=1 refuses all network access.

Building from source

Requirements: Rust (stable), bun, and platform libraries (Xcode command-line tools on macOS; ALSA, fontconfig, and Vulkan libraries on Linux).

git clone https://github.com/shinyobjectz/raea && cd raea
cargo build --release -p raea-cli --no-default-features
target/release/raea render sdk/react/bench/games/pong/edit.tsx -o pong.mp4

--no-default-features builds the public engine, matching the official releases. The default features add one hosted service — Content Credentials signed by raea's signing server — which is not part of this repository.

Project structure

The workspace is layered from pure building blocks up to the command line tool:

Folder Purpose
core/ Pure building blocks: the kernel language (K, interpreted on CPU and compiled to WGSL), easing/animation, shapes, fonts, scene and wire formats
gpu/ The single shared GPU device and its telemetry
io/ Decode/encode (VideoToolbox, software codecs, AV1, a muxer), files, network, npm packages, traces
systems/ Engine systems: layout, canvas, compositing, filters, mixing, speech, ML (ONNX Runtime), footage reading, lighting, contact checks for 3D parts, splats
runtime/ Running a composition: JavaScript engine seam (JavaScriptCore on macOS, QuickJS elsewhere), React and HTML on Bevy, baking, encode, live play
engine/ The renderer, the in-process TypeScript bundler, the Bevy plugin catalog, and the raea command itself
apps/ Crates behind the CLI's verbs: check, play, games, media
sdk/ The TypeScript SDK, its 3D/physics/audio/video/UI packages, craft guides, and agent skills
vendor/ Patched upstream crates under their own licences (with reasons in vendor/vendor.toml)
tools/ Build and release helpers

Behaviour specifications written in Gherkin (.feature files) sit beside the code they describe.

Licence

raea is under the Functional Source License 1.1, ALv2 Future License (FSL-1.1-ALv2), copyright Shane Murphy. You may use, change, build on, and pass it on for anything except a product that competes with raea. Each version becomes Apache-2.0 two years after its release. Third-party components keep their own licences (see NOTICE).


All facts above are drawn directly from the project's README; nothing has been added or inferred beyond what that document states.

Related

  • Project
  • Project
  • Project
  • Project