CopilotKit/openmuse
A personal agent with a browser, terminal, files, and work that keeps going built with CopilotKit and AG-UI.
What it solves
OpenMuse is a personal agent application designed to handle complex, multi-step tasks that require interaction with a web browser, a terminal, and personal data (like email and calendars). It allows users to delegate outcomes—such as researching a topic or filling out a form—and review the agent's actions before they are finalized, ensuring the agent can work in the background while remaining under user control.
How it works
OpenMuse uses a modular architecture consisting of a central API (built with Hono and CopilotKit), a durable task worker for managing long-running processes, and specialized workers for different environments:
- Agent Computer: A combination of a persistent Chromium browser (via Playwright) and an optional isolated Linux container for running commands and managing files.
- Integrations: Google OAuth adapters for Gmail and Calendar access.
- Persistence: Uses PGlite or PostgreSQL for state and CopilotKit Intelligence for conversation history.
- User Interface: A cross-platform app (iOS, Android, and Web) that provides a chat interface and a "Take control" feature to jump directly into the agent's active browser session.
Who it’s for
It is intended for developers and power users who want a self-hosted personal agent that can interact with the real world via a browser and terminal, and for those looking to build upon a template for their own AI agent applications.
Highlights
- Persistent Browser & Terminal: The agent maintains browser profiles and a Linux workspace, allowing users to take over the session manually.
- Durable Tasking: Supports task plans with progress tracking, pause/resume/cancel capabilities, and a review-based approval system for external writes.
- Rich Integrations: Native support for Gmail, Google Calendar, and PDF processing (reading, filling, and sharing).
- Cross-Platform: Built with React Native for seamless deployment across mobile and web.
- Web Search: Integrated keyless search via Parallel's Search MCP.
Related
- Project
- Project
- Project
- Project
- Project