Project-N-E-K-O/N.E.K.O

What it solves

N.E.K.O. aims to move beyond simple task-oriented agents or static roleplay interfaces by creating a "digital life" that provides proactive companionship. It addresses the limitations of standard LLM interfaces by providing persistent memory, real-time sensory perception, and the ability to interact with the user's digital environment.

How it works

The system integrates multiple AI services (including OpenAI, Gemini, and Qwen) to power a variety of interaction modes. It utilizes a five-dimensional memory system (working, recent, factual, reflective, and persona memory) to ensure long-term continuity. The platform supports real-time voice and visual understanding and can execute tasks via browser automation and computer use agents. Users can interact with the AI through various avatars like Live2D, VRM, or MMD.

Who it’s for

• Users seeking an interactive, proactive AI companion that grows with them through shared experiences.
• Developers looking to build upon an open-source AI companion framework.
• Creators (artists, voice actors, writers) who want to contribute custom characters, models, or voice packs via the Steam Workshop.

Highlights

• Proactive Companionship: Actively initiates conversation based on social trends, user activity, or music.
• Five-Dimensional Memory: Maintains continuity through factual, reflective, and persona-based memory layers.
• Multi-Modal Interaction: Supports real-time voice, text, and visual understanding.
• Diverse Avatars: Supports Live2D, VRM, MMD, PNGTuber, and desktop pet modes.
• Agent Capabilities: Can operate browsers and computers to perform tasks.
• Extensive Ecosystem: Features a plugin marketplace and Steam Workshop integration for custom characters and assets.