localai-org/motion-bricks.cpp

NVIDIA MotionBricks ported to GGML/C++; dynamically generates animations from keyframes using a neural network. Can be used in games or with robots

What it solves

This project provides a high-performance, portable C++ implementation of NVIDIA's MotionBricks, a system for generating skeletal animations and motion control. It allows developers to run these motion models on standard CPUs and Vulkan-compatible hardware, rather than relying exclusively on heavy GPU-based training frameworks.

How it works

It uses the GGML library to load and execute GGUF-formatted model weights. The system handles the entire inference pipeline: from loading the model and style bundles to planning motion, predicting pose tokens, and decoding them into skeletal animations. It exposes a stable C ABI, which allows it to be integrated into other languages—such as Go—without requiring complex Cgo bindings. It also includes optional support for MuJoCo physics simulation to drive realistic animation playback.

Who it’s for

This project is for developers and researchers working on robotics, character animation, or embodied AI who need to integrate high-quality motion generation into applications running on edge devices or standard server hardware.

Highlights

  • Implements the full G1 inference path, including root planning, pose prediction, and VQ decoding.
  • Provides a stable C ABI for easy integration with other programming languages like Go.
  • Supports both CPU and Vulkan backends for flexible hardware deployment.
  • Includes tools for parity validation against upstream NVIDIA reference implementations to ensure motion accuracy.
  • Offers an interactive demo with a Three.js frontend to visualize skeletal movement and control.

Related

  • Project
  • Project
  • Project
  • Project