cuevhv/mamma

Official code for MAMMA: Markerless Accurate Multi-person Motion Acquisition.

What it solves

MAMMA는 피사체의 몸에 물리적인 마커를 사용하지 않고도 멀티뷰 영상에서 여러 사람의 3D 모션을 정확하게 캡처할 수 있는 방법을 제공합니다.

How it works

The system uses a multi-stage pipeline to process video captures:

  1. Capture (ma_cap): Loads the multi-view video data.
  2. Segmentation (ma_masks): Uses SAM and YOLO to isolate individual people in the frames.
  3. 2D Landmark Detection (ma_2d): Employs a specialized network called MammaNet to detect 2D body landmarks.
  4. 3D Optimization (ma_3d): Performs multi-view SMPL-X optimization to reconstruct the 3D body poses.
  5. Visualization (ma_vis): Generates per-camera overlays and an interactive 3D scene.

Who it’s for

Researchers and developers in computer vision, animation, and motion capture who need high-fidelity 3D human motion data from standard multi-camera setups.

Highlights

  • Markerless approach: Eliminates the need for specialized markers on subjects.
  • Multi-person support: Capable of tracking and reconstructing multiple people simultaneously.
  • Integrated GUI: Includes a browser-based interface for submitting and inspecting runs.
  • Comprehensive Pipeline: Combines segmentation, 2D pose estimation, and 3D optimization into a single workflow.