jofizcd/Soul-of-Waifu

What it solves

Soul of Waifu is a desktop application designed to move AI characters beyond simple text chat. It creates a persistent, evolving identity for AI characters that can exist across different interaction modes—chat, tabletop RPGs, and as an autonomous desktop agent—while maintaining a continuous memory and personality.

How it works

The project uses a multi-dimensional architecture where a single character identity is shared across four primary modules:

• Soul Memory: A cognitive architecture that replaces basic RAG with four specialized layers (Psychology, Relationship, Episodic, and Diary) to track mood, trust, and history.
• Text & Voice Chat: A conversational interface supporting Live2D/VRM avatars, real-time voice calls, and various TTS/STT engines.
• Soul Stage: A tabletop RPG engine with a virtual Game Master, deterministic dice rolls, and world-state tracking.
• Soul Companion: An autonomous Windows desktop agent that can read the screen, control the mouse and keyboard, browse the web, and run sandboxed code.

It supports both local LLM execution (via Llama.cpp with CUDA/HIP/SYCL/Vulkan support) and cloud APIs (OpenAI, Claude, Gemini, etc.).

Who it’s for

It is aimed at users who want highly immersive AI companions, roleplayers who need a structured tabletop RPG simulator, and users looking for an autonomous OS-level agent for desktop automation.

Highlights

• Autonomous OS Agent: Can control GUI elements, browse the web via Playwright, and execute Python/PowerShell scripts with a human-in-the-loop approval system.
• Advanced Memory: Features emotional decay, self-healing memory logs to fix contradictions, and a personal diary written by the AI.
• TTRPG Engine: Includes a dedicated Game Master layer, hidden story arcs, and a campaign board with pressure clocks.
• Local-First Privacy: Runs 100% locally by default with no subscriptions or filters.
• Extensibility: Supports custom Python plugins and MCP servers for the desktop agent.