huangserva/3DCellForge

What it solves

3DCellForge (3D Model Studio) provides a unified, interactive workspace for generating and inspecting 3D models from 2D images. It eliminates the need to switch between multiple image-to-3D AI providers and separate 3D viewing software by integrating generation, quality assessment, and presentation into a single studio environment.

How it works

The project is a React and Three.js application that connects to various image-to-3D AI backends. Users upload a reference image, choose a generation provider (such as Hyper3D, Tripo, Fal.ai, or a local Hunyuan3D instance), and the system generates a GLB file.

Key technical components include:

• WebGL Stage: A central viewer built with React Three Fiber for real-time model inspection and orbit controls.
• Backend Integration: A Node.js backend that manages API keys securely and caches generated models locally to avoid redundant API calls.
• AI Analysis: Optional integration with OpenAI's vision capabilities to automatically classify assets, suggest materials, and refine prompts for better 3D generation.
• Persistence: Uses IndexedDB and localStorage to ensure that the model library and generation history survive page refreshes.

Who it’s for

This tool is designed for 3D artists, product designers, and developers who need to quickly prototype 3D assets from images and present them in a professional, cinematic manner without requiring complex 3D software.

Highlights

• Multi-Provider Support: Seamlessly switch between cloud providers like Tripo, Fal.ai, and Hyper3D, or use a local Hunyuan3D API.
• Object-Aware Inspector: Automatically categorizes models (e.g., vehicles, aircraft, organic specimens) and provides specific metadata and quality scores.
• Cinematic Demo Mode: A presentation mode that hides UI panels and uses automated camera paths tailored to the asset type (e.g., flight paths for aircraft).
• Integrated Quality Scoring: Evaluates generated GLBs based on triangle count, file size, and texture count to determine if they are "demo-ready."
• Local GLB Import: Supports importing existing .glb or .gltf files for inspection and presentation.