mitsuba-renderer/mitsuba3

What it solves

Mitsuba 3 provides a research-oriented system for simulating both forward and inverse light transport. It allows researchers to create highly realistic images and, crucially, perform "inverse rendering" by calculating how changes in input parameters (like camera position or material properties) affect the final image.

How it works

It uses a core library with a plugin system for materials and light sources. The system is built on Dr.Jit, a specialized just-in-time (JIT) compiler that allows the same code to be retargeted for different tasks, such as running classic one-ray-at-a-time simulations or high-performance GPU-accelerated spectral transport. It is deeply integrated with Python, allowing users to develop rendering algorithms that are JIT-compiled and differentiated on the fly.

Who it’s for

It is designed for researchers in computer graphics and other disciplines who need a high-performance, differentiable rendering system for experimentation.

Highlights

• Differentiable Rendering: Can compute derivatives of the entire simulation relative to inputs like geometry, textures, and camera pose.
• Python-First: Materials and full rendering algorithms can be developed directly in Python.
• High Performance: Utilizes LLVM for CPU and CUDA/OptiX for NVIDIA GPUs with hardware acceleration.
• Flexible Modalities: Supports monochromatic, RGB, and spectral rendering, with optional polarization effects.