ButzYung/SystemAnimatorOnline

What it solves

XR Animator is a real-time AI motion capture application that allows users to drive 3D avatars (such as MMD or VRM models) using only a single webcam. It eliminates the need for expensive motion capture hardware, making full-body tracking accessible for VTubing, the metaverse, and other 3D content creation.

How it works

The application leverages machine learning models from MediaPipe and TensorFlow.js to detect 3D poses from a live webcam feed. This detected motion is then mapped to a 3D avatar in real-time. It supports various tracking configurations, including face, full body, or a combination of both and hands.

Who it’s for

It is designed for VTubers, 3D artists, and XR/AR developers who want a low-barrier entry to motion capture and avatar animation.

Highlights

• Multi-platform support: Available as a web app (compatible with major browsers and smartphones) and a native desktop app (Windows, Linux, macOS).
• Comprehensive tracking: Supports full-body AI motion tracking and "Perfect Sync"/ARKit-compatible face tracking with 52 blendshapes.
• Avatar compatibility: Works with MMD and VRM models.
• Motion export/import: Ability to record mocap data and export it to VMD, BVH, or glTF formats.
• AR Mode: Augmented Reality support for Android Chrome browsers using ARCore and WebXR.
• External Integration: Supports the VMC-protocol to send animation data to other VMC-enabled apps like VSeeFace or Warudo (Electron version only).