MIT-SPARK/Hydra

What it solves

Hydra provides a way for robots to understand their environment in real-time by building 3D Scene Graphs. This allows a robot to move beyond simple maps and instead create a hierarchical representation of a space, identifying objects, rooms, and the overall structure of an environment as it explores.

How it works

Hydra is a spatial perception system that incrementally constructs and optimizes these 3D scene graphs. It integrates semantic segmentation and spatial data to organize the environment into a hierarchy. Recent updates have introduced open-set semantic capabilities and room category classification networks to improve how the system identifies and categorizes different parts of a scene.

Who it’s for

This project is designed for robotics researchers and practitioners who are familiar with the Robot Operating System (ROS) and 3D scene graph research.

Highlights

• Real-time construction: Builds and optimizes 3D scene graphs on the fly.
• Hierarchical representation: Organizes spatial data into a structured graph of the environment.
• Open-set semantics: Supports the ability to identify semantic labels in a more flexible manner.
• ROS2 Integration: Now defaults to ROS2 Jazzy on Ubuntu 24.04.