dimensionalOS/dimos
Dimensional is the agentic operating system for physical space. Command humanoids, quadrupeds, drones, and other hardware platforms in natural language and build multi-agent systems that work seamlessly with physical input (cameras, lidar, actuators).
What it solves
DimOS is an operating system and SDK for generalist robotics, designed to remove the complexity of robot programming. It eliminates the need for ROS (Robot Operating System) by allowing developers to build physical applications entirely in Python, providing a standardized way to integrate with various robot manufacturers (humanoids, quadrupeds, drones, and arms).
How it works
DimOS uses a modular architecture where robot subsystems are defined as "Modules" that communicate via standardized messages. These modules are wired together using "Blueprints," which act as instructions for constructing and connecting the robot's data streams. The system is "agent native," meaning LLM-based agents can run as native modules, subscribing to perception streams (like LiDAR and cameras) and controlling motor drivers directly. It also supports multiple transport layers (LCM, SHM, DDS, Zenoh, ROS 2) and provides a CLI for managing agent lifecycles and calling skills via the Model Context Protocol (MCP).
Who it’s for
Robot developers and AI researchers who want to build agentic physical applications without the overhead of ROS, and those who need a cross-platform SDK that works across different hardware platforms like Unitree Go2, G1, and DJI drones.
Highlights
- Agent-Native Design: Allows "vibecoding" robots using natural language and building multi-agent systems that interact with hardware.
- Spatial Memory: Implements spatio-temporal RAG and object localization for robots to remember and find objects.
- Hardware Agnostic: Supports a wide range of platforms including quadrupeds, humanoids, robotic arms, and drones.
- dimTELE: A hosted remote teleoperation system that allows controlling robots via a browser or Quest headset over WebRTC without needing to open inbound ports.
- MCP Integration: Uses the Model Context Protocol to expose robot skills as tools that agents can call.
Related
- Project
- Project
- Project
- Project
- Project