moeru-ai/airi

💖🧸 Self hosted, you-owned Grok Companion, a container of souls of waifu, cyber livings to bring them into our worlds, wishing to achieve Neuro-sama's altitude. Capable of realtime voice chat, Minecraft, Factorio playing. Web / macOS / Windows supported.

What it solves

Project AIRI aims to create a "soul container" for AI virtual characters (cyber waifus or digital companions) that can do more than just chat. While existing AI chat platforms provide roleplay, AIRI focuses on creating a digital human capable of interacting with the real world, playing games (like Minecraft and Factorio), and engaging with users across various platforms like Discord and Telegram.

How it works

AIRI combines large language models (LLMs) with a suite of sensory and motor capabilities:

  • Brain: Integrates with numerous LLM providers (OpenAI, Claude, DeepSeek, etc.) and is being developed to play games and maintain memory via in-browser databases (DuckDB WASM, pglite).
  • Ears: Handles audio input from browsers and Discord, featuring client-side speech recognition and talking detection.
  • Mouth: Supports multiple voice synthesis providers, including ElevenLabs and local Kokoro TTS.
  • Body: Supports VRM and Live2D models with automated animations for blinking, looking, and idle movements.

The project is built using a mix of Web technologies (WebGPU, WebAssembly, WebAudio) for cross-platform accessibility (Browser, PWA, Mobile) and native acceleration (NVIDIA CUDA, Apple Metal) for the desktop version.

Who it’s for

  • Users who want a personalized, interactive digital companion or AI VTuber.
  • Developers and artists interested in building AI-driven virtual characters using Web and AI technologies.
  • Creators looking to implement AI agents that can interact with games and external communication apps.

Highlights

  • Cross-Platform: Runs on modern browsers, mobile devices (PWA), and desktop (Windows, macOS, Linux).
  • Game Integration: Capable of playing Minecraft and Factorio, with other games like Kerbal Space Program and Helldivers 2 in development.
  • Broad LLM Support: Compatible with a vast array of API providers via the xsai library.
  • Visual Fidelity: Full support for Live2D and VRM models with autonomous animations.

Related

  • Project
    dabit3/react-native-ai

    A full-stack framework for building cross-platform mobile AI apps with built-in support for real-time LLM streaming and image generation.

  • Project
    morettt/my-neuro

    A workbench for creating personalized, human-like AI companions with customizable voices, personalities, and Live2D avatars, supporting local LLM inference and gaming integration.

  • Project
    worm128/AI-YinMei

    An all-in-one AI live-streaming platform that integrates LLMs, streaming TTS, and Live2D avatars to create interactive AI personas for platforms like Bilibili and TikTok.

  • Project
    bigsk1/voice-chat-ai

    A voice-driven AI interface that allows users to interact with diverse AI characters using a variety of LLM and TTS providers, supporting real-time conversations and local voice cloning.

  • Project
    steve02081504/fount

    A programmable, modular AI agent runtime platform that allows users to create and deploy highly customizable agents for both productivity and immersive interaction.