stereolabs/zed-unity
ZED SDK Unity plugin
What it solves
This plugin allows developers to integrate ZED camera features—such as depth sensing, spatial mapping, and object detection—directly into the Unity game engine, simplifying the creation of mixed reality (MR) and augmented reality (AR) applications.
How it works
It provides a set of prefabs, helper scripts, and example scenes that interface with the ZED SDK. This allows Unity projects to utilize the camera's hardware capabilities for real-time environment scanning and human tracking.
Who it’s for
Unity developers creating AR/MR experiences, robotics simulations, or interactive installations that require real-time 3D perception of the physical world.
Highlights
- Spatial Perception: Includes point cloud visualization, plane detection, and spatial mapping to create meshes of the real environment.
- Human Tracking: Supports body tracking to animate 3D avatars based on real-person movements.
- Object Interaction: Features object detection (bounding boxes) and ArUco marker detection via OpenCV.
- Mixed Reality Integration: Supports depth occlusion, camera tracking, and compatibility with OpenVR and Oculus HMDs.