Vali-98/ChatterUI

A frontend for running models on mobile or connecting to your preferred API providers.

What it solves

ChatterUI provides a native mobile frontend for interacting with Large Language Models (LLMs), filling the gap for users who want a mobile-friendly interface with detailed control over how chats are structured and managed.

How it works

The app operates in two primary modes:

  • Local Mode: Uses llama.cpp via a custom React Native adapter (cui-llama.rn) to run GGUF model files directly on the mobile device's hardware.
  • Remote Mode: Connects to external LLM providers through APIs. It supports open-source backends like Ollama and koboldcpp, commercial services like OpenAI and Claude, and generic chat/text completion backends.

Who it’s for

It is designed for mobile users who want to run LLMs locally on their phones or connect to various AI APIs while maintaining fine-grained control over model settings and character personas.

Highlights

  • Character Support: Supports the Character Card v2 specification for chatting with specific personas.
  • Flexible Model Loading: Allows importing models into the app or using external files from device storage.
  • Customization: Offers adjustable sampler fields and instruct formatting.
  • API Versatility: Includes a template system to define custom APIs if a provider is not natively listed.
  • Accessibility: Integrates with the device's native text-to-speech (TTS) engine.

Related

  • Dispatch
    LLM Inference on Edge: Running Local LLMs via React Native

    Hugging Face provides a comprehensive guide to building a privacy-focused mobile application using React Native and llama.rn to run quantized GGUF models locally on Android and iOS.

  • Project
    addyosmani/chatty

    A private, in-browser AI chat interface that uses WebGPU to run LLMs locally on your hardware for offline use and data privacy.

  • Project
    Mobile-Artificial-Intelligence/maid

    An open-source Android application for running LLMs locally via llama.cpp or connecting to remote AI providers like OpenAI and Anthropic.

  • Project
    ggml-org/Llama-macOS

    A macOS menu bar app for running local LLMs using llama.cpp, featuring zero-configuration setup and hardware-aware model recommendations.

  • Project
    netdur/llama_cpp_dart

    A Dart FFI binding for llama.cpp that enables running LLMs, vision, and audio models locally within Flutter apps on iOS and Android.