PeterFWS/Structure-PLP-SLAM

[ICRA'23] The official Implementation of "Structure PLP-SLAM: Efficient Sparse Mapping and Localization using Point, Line and Plane for Monocular, RGB-D and Stereo Cameras"

What it solves

Structure PLP-SLAM addresses the challenge of efficient sparse mapping and localization in various environments. By incorporating points, lines, and planes into the SLAM (Simultaneous Localization and Mapping) process, it improves the robustness and accuracy of camera tracking and environment reconstruction compared to systems that rely solely on point features.

How it works

The system processes visual data from monocular, RGB-D, or stereo cameras. It utilizes a combination of geometric primitives—points, lines, and planes—to build a sparse map of the environment. For planar SLAM, it integrates instance planar segmentation (using tools like PlaneRecNet) to identify planes in the scene. The system also supports re-localization, allowing a camera to find its position based on a pre-built map, and can optionally perform depth-based dense reconstruction for RGB-D data.

Who it’s for

This project is designed for robotics researchers and developers working on visual SLAM, specifically those needing high-performance localization and mapping across different camera configurations (monocular, stereo, and RGB-D).

Highlights

  • Multi-Primitive Mapping: Uses points, lines, and planes to create a more comprehensive sparse map.
  • Camera Versatility: Compatible with monocular, RGB-D, and stereo camera setups.
  • Re-localization Support: Ability to perform map-based image localization using pre-existing maps.
  • Integration with PlaneRecNet: Leverages CNN-based instance planar segmentation for improved plane detection.

Related

  • Project
  • Project
  • Project
  • Project
  • Project