SpatiaOS/Procedura

What it solves

Procedura enables the creation of editable, parametric 3D models from simple text prompts or reference images. Unlike traditional AI 3D generation that produces "static" geometry like point clouds or triangle meshes, Procedura generates source code (OpenSCAD) that can be opened, edited, and re-compiled, allowing for precise control over the resulting object.

How it works

The system uses a frozen Large Language Model (LLM) to write a parametric program. It follows a multi-stage pipeline:

1. Planning: It breaks the object down into a list of named parts.
2. Drafting: It builds these parts one by one, optionally using 3D feedback (renders of the build-so-far) to guide the process.
3. Refining: It enters a loop of rendering, critic feedback, and patching to improve the shape.
4. Post-Processing: It can assign PBR materials via vision calls and plan articulation for motion export to OpenUSD or URDF.

Who it’s for

• 3D Designers: Who want a starting point for parametric models that they can manually refine.
• Robotics Engineers: Who need 3D models with defined articulation and URDF exports for physics validation.
• Developers: Who want to generate structured 3D assemblies from text or images without needing a specialized 3D-trained model.

Highlights

• Editable Output: Generates OpenSCAD code rather than raw meshes, making the geometry parametric and modifiable.
• Agentic Workflow: Uses a render-critic-patch loop to iteratively refine the 3D model.
• Reference-Guided: Supports using reference images to significantly increase the fidelity of the reconstruction.
• Assembly Logic: Can implement real mating features (pegs, sockets, bolts) instead of simple overlapping parts.
• Motion Support: Exports articulation to OpenUSD and URDF, with optional validation in NVIDIA Isaac Sim.