PozzettiAndrea/ComfyUI-Sharp

What it solves

ComfyUI-Sharp provides a way to generate 3D Gaussian Splats from a single 2D image in under one second. It integrates the SHARP model by Apple into the ComfyUI node-based interface, allowing users to quickly create 3D representations of objects or scenes from monocular images.

How it works

The project acts as a wrapper for the SHARP model. It provides specific nodes for loading the model, performing predictions to generate 3D Gaussians, and handling image inputs. It includes a specialized node to extract focal length data from an image's EXIF metadata to improve the 3D reconstruction accuracy.

Who it’s for

Users of ComfyUI who want to incorporate fast, single-image 3D reconstruction into their workflows, specifically using Gaussian Splatting technology.

Highlights

• Fast Inference: Generates 3D Gaussians in under one second.
• EXIF Integration: Automatically calculates focal length from image metadata using a dedicated node.
• Ready-to-use Workflows: Includes three example workflows for standard input, EXIF-based input, and panorama Gaussians.
• Automatic Model Management: The model is automatically downloaded on the first run.