kuafuai/andee

What it solves

Andee is an Android-based agent designed to act as a persistent, autonomous "resident" on your device rather than a traditional cloud-based assistant. It solves the problem of fragmented, vendor-locked AI assistants by running locally, maintaining its own private memory, and interacting with any app on your phone without requiring specific integrations or SDKs.

How it works

Andee functions as a single Android APK that utilizes the system's AccessibilityService to "see" the screen and perform actions, and WindowManager to display a floating interface. It operates by connecting to any OpenAI-compatible LLM endpoint (local or remote) to process requests. It uses a grid-based system to interact with UI elements, types text directly into fields, and manages a local "notebook" of user habits and promises. It can also interface with hardware like a robot dog via USB OTG to enable physical movement.

Who it’s for

This project is for power users and developers who want a highly autonomous, privacy-focused AI agent that lives on their device, maintains a consistent persona, and can perform complex, multi-step tasks across any installed application.

Highlights

• Local-first privacy: Keeps your notebook, habits, and memory on the device, with no vendor cloud profile.
• Universal app interaction: Uses accessibility services to interact with any app, requiring no special integrations or APIs.
• Autonomous behavior: Can act independently when not being watched, such as reviewing conversations or managing tasks.
• Dynamic persona: Features a floating interface with customizable faces and moods that change in real-time based on the model's output.
• Hardware integration: Supports physical hardware like robot dogs, treating them as an extension of the device's body.