inspatio/querysplat

repo for QuerySplat

What it solves

QuerySplat addresses the challenge of predicting 3D Gaussian Splatting (3DGS) representations from images by decoupling the geometry and appearance representations, allowing for more accurate 3D scene reconstruction.

How it works

The system uses a feed-forward model to predict 3D Gaussians and render them. It integrates with VGGT-Omega for image encoding, camera prediction, and depth prediction. The pipeline includes custom-image preprocessing and offers an optional Test-Time Optimization (TTO) step to further refine the predicted 3D scene based on reconstruction objectives like LPIPS.

Who it’s for

This project is designed for researchers and developers working in 3D computer vision, specifically those focused on 3D Gaussian Splatting and neural scene representation.

Highlights

  • Decouples geometry and appearance for better 3DGS prediction.
  • Supports both fast feed-forward inference and refined test-time optimization (TTO).
  • Integrates with VGGT-Omega for robust camera and depth estimation.
  • Provides tools for exporting Gaussian PLY files and analyzing opacity and scale distributions.

Related

  • Project
  • Project
  • Dispatch
  • Project
  • Dispatch