nvidia-isaac/nvblox

A GPU-accelerated TSDF and ESDF library for robots equipped with RGB-D cameras.

What it solves

nvblox provides a high-performance solution for real-time 3D scene reconstruction in robotics. It allows robots to map their surroundings in 3D, enabling them to understand geometry and navigate complex environments effectively.

How it works

The library performs 3D reconstruction directly on the GPU using NVIDIA CUDA hardware. It builds, manipulates, and queries spatial data structures in real-time, allowing for tasks like texture mapping and the generation of Euclidean Signed Distance Fields (ESDFs) for path planning.

Who it’s for

It is designed for robotics developers and researchers who need efficient, real-time spatial perception for autonomous systems. It supports integration through C++, Python, and ROS2.

Highlights

  • Real-time 3D reconstruction optimized for NVIDIA GPUs
  • Supports multiple interfaces: C++, Python, and ROS2
  • Capable of generating ESDFs for navigation and path planning
  • Handles complex tasks like multi-camera reconstruction and texture mapping

Related

  • Project
    loco-3d/crocoddyl

    An optimal control library for robot control under contact sequences that uses efficient Differential Dynamic Programming (DDP) algorithms to compute optimal trajectories.

  • Project
    thu-ml/Motus

    Motus is a research‑grade codebase that combines a 5 B video‑generation model, a 2 B vision‑language model, and two smaller experts into a Mixture‑of‑Transformers world model. It learns latent robot actions from optical‑flow “delta‑pixels” and can be run in several modes (world‑model prediction, VLA, inverse dynamics, video generation). The repo supplies three‑stage training scripts, data‑conversion tools for RoboTwin 2.0 and real‑robot logs, and Hugging Face checkpoints. On the RoboTwin 2.0 benchmark it reports 87 % success, outperforming prior baselines.

  • Project
    neozhaoliang/surround-view-system-introduction

    An open‑source, beginner‑friendly implementation of a vehicle surround‑view system that covers camera calibration, projection to a ground plane, image stitching, and real‑time display. Includes step‑by‑step Chinese and English docs, sample data, and encourages community contributions.

  • Project
    mjbots/moteus

    An open-source project providing full hardware and firmware designs for high-performance brushless servo actuators used in robotics.