iamlukethedev/Hermes3D

What it solves

AI agents typically operate in the background, with their activity hidden behind logs, terminal outputs, and dashboards. Hermes3D solves this by providing a visual, immersive 3D workspace where users can see their AI workforce in real-time, making their operations more understandable through spatial presence and motion.

How it works

Hermes3D acts as a visualization and interaction layer (the "Studio") that connects to an agent backend via a gateway protocol. It uses a WebSocket proxy to stream updates from the backend to the browser. The system supports multiple runtimes, including a bundled Hermes adapter, a custom HTTP runtime provider for orchestrator-backed stacks, and a mock demo gateway for exploration.

Who it’s for

Developers and teams who run self-hosted AI agent frameworks and want a spatial interface to monitor, manage, and interact with their agents as they perform tasks like code reviews, standups, and QA monitoring.

Highlights

• Immersive 3D Office: A retro-style virtual office where agents appear as workers moving through a shared world.
• Dual Rendering Modes: Includes both a 3D view and a 2D pixel-art view (Gather-style) for lower-power machines.
• Operational Spaces: Dedicated immersive surfaces for GitHub pull request reviews, standups, and system monitoring.
• Backend Neutrality: A gateway-first architecture that allows integration with various agent runtimes without rewriting the UI.
• Office Builder: A dedicated surface for editing and publishing custom office layouts.