AlphaAvatar/AlphaAvatar

A real-time interactive Omni Avatar built on LiveKit, which allows you to seamlessly integrate with any open source Avatar components (real-time model, visual, voice, memory, search, etc.).

What it solves

AlphaAvatar provides a framework for building self-hostable, privacy-first personal AI assistants that act as "intelligent butlers." It moves beyond simple chatbots by enabling agents to be stateful, proactive, and multimodal, allowing them to remember user preferences, plan long-term tasks, and interact across various channels like voice, text, and video.

How it works

The system uses a plugin-based real-time agent architecture that processes multimodal observations (voice, camera, screen) through a core perception layer. It integrates several key modules:

  • Memory & Persona: Uses graph-aware multimodal memory and automatic persona extraction to maintain identity continuity and user understanding.
  • Interaction Router: Manages real-time speech routing, turn-taking, and interruptions.
  • Tool Integration: Connects to the external world via MCP (Model Context Protocol), RAG for document retrieval, and DeepResearch for web searching.
  • Virtual Character: Provides a visual representation of the assistant for real-time interaction.
  • Infrastructure: Connects to various LLM providers and storage backends (like LanceDB or Qdrant) for vector and identity data.

Who it’s for

It is designed for developers and users who want a highly personalized, self-hosted AI companion capable of managing personal life metrics, organizing knowledge, scheduling tasks, and executing autonomous multi-step workflows.

Highlights

  • Privacy-First: Fully self-hostable, giving users total control over their data and memory.
  • Multimodal Interaction: Supports real-time voice, text, and camera inputs with a dedicated virtual character interface.
  • Proactive Planning: Includes modules for task decomposition, reminders, and long-horizon goal execution.
  • Extensible Tooling: Integrates with MCP for external APIs and RAG for personal knowledge bases.
  • Diverse Access Channels: Available via a web demo, LiveKit playground, and messaging platforms like WhatsApp.

Related

  • Project
  • Project
  • Project
  • Dispatch
  • Project