IBM/terramind

What it solves

TerraMind is designed to handle the complexity of Earth Observation (EO) data, providing a foundation model capable of any-to-any generative tasks across different modalities of geospatial data. It allows users to generate one type of geospatial information from another and fine-tune the model for specific environmental monitoring tasks like flood detection or crop classification.

How it works

TerraMind uses a generative foundation model architecture that supports multiple model sizes (tiny, small, base, and large). It employs a "Thinking-in-Modalities" (TiM) approach, where the model predicts intermediate modalities as a step toward the final output. The system is integrated with the TerraTorch toolkit for fine-tuning and uses a set of six tokenizers for pre-training and generation.

Who it’s for

This project is for researchers and developers working in geospatial AI, Earth Observation, and environmental monitoring who need a foundation model that can process and generate multimodal geospatial data.

Highlights

• Any-to-any generation: Capable of generating geospatial data across varying combinations of inputs.
• Thinking-in-Modalities (TiM): A novel approach where intermediate modalities are predicted to improve performance.
• Integrated Toolkit: Fully integrated into TerraTorch for streamlined fine-tuning without requiring extensive code.
• Open-sourced Weights: Available in four different sizes to suit different hardware constraints.