MixedRealityToolkit/MixedRealityToolkit-Unity

This repository holds the third generation of the Mixed Reality Toolkit for Unity. The latest version of the MRTK can be found here.

What it solves

MRTK3 is an open-source toolkit designed to accelerate the development of cross-platform mixed reality (MR) experiences in Unity. It provides a modular framework that simplifies the process of creating interactions and user interfaces that work across a wide variety of hardware devices and platforms.

How it works

Built on top of Unity's XR Interaction Toolkit (XRI) and OpenXR, MRTK3 uses a modular package-based architecture. This allows developers to integrate only the necessary components—such as input systems, UX components, and spatial manipulation tools—into their projects. It leverages the Unity Input System to provide a unified way to handle input from various devices, including hand tracking, gamepads, and mice.

Who it’s for

Developers creating mixed reality applications for devices like HoloLens 2, Meta Quest, Magic Leap 2, and Android XR, as well as those targeting traditional flat-screen desktops for testing.

Highlights

  • Cross-Platform Support: Dedicated to OpenXR, supporting a broad range of devices including HoloLens 2, Meta Quest, and Magic Leap 2.
  • Performance Optimized: Redesigned for zero per-frame memory allocation to maximize performance on resource-constrained mobile MR devices.
  • Modular UX Components: Includes a library of production-grade 3D UX building blocks like volumetric buttons, sliders, and hand-anchored menus.
  • Extensible Architecture: Built on Unity's XR Interaction Toolkit and Input System for an open-ended approach to interaction paradigms.
  • Data Binding: Supports data binding for branding, theming, and dynamic data management in complex lists.

Related

  • Project
    deepopen-com/deepopen-3d-webs

    DeepOpen-3d-webs (Guangyu Zaojing) is a Docker-shipped, image-driven 3D scene generator: give it one reference image and a prompt, and it produces camera-trajectory scene results — color/depth animations and Gaussian point clouds — previewable in the browser. It has five tabs (Workbench, Scene Generation, Example Gallery, Task History, System Status), runs in GPU-free demo mode by default, and switches to a full LucidDreamer-based generation engine when CUDA and model weights are available. No login; anyone who can reach port 8090 can use it.

  • Project
    zju3dv/Scal3R

    Scal3R is a scalable 3D reconstruction framework that uses test-time training to generate camera poses, depth maps, and point clouds from image sets.

  • Project
    3dem/relion

    RELION is a software program for the Maximum A Posteriori refinement of 3D reconstructions and 2D class averages in cryo-electron microscopy.

  • Project
    3DiVi/nuitrack-sdk

    A 3D body and skeletal tracking library that provides a unified API for various depth sensors across multiple platforms, enabling human-centric spatial understanding.