LeanBitLab/LeanType

What it solves

LeanType is a privacy-focused Android keyboard that integrates advanced AI capabilities directly into the typing experience. It solves the problem of having to switch between multiple apps for tasks like grammar proofreading, translation, voice-to-text, and text extraction from images, all while offering options for complete offline operation to ensure data privacy.

How it works

The project is a fork of HeliBoard (based on OpenBoard/AOSP LatinIME) and extends it with a plugin-based architecture. It supports multiple AI backends:

• Cloud AI: Connects to providers like Google Gemini, Groq, OpenAI, or self-hosted servers (Ollama, LM Studio) via API.
• On-Device AI: Uses llama.cpp for local GGUF language models and whisper.cpp for on-device speech recognition.
• Specialized Plugins: Employs ML Kit for OCR (camera/screenshot text extraction), translation, and handwriting recognition.

Who it’s for

Android users who want a highly customizable, productivity-oriented keyboard with integrated AI tools, ranging from privacy purists who require 100% offline functionality to power users who utilize cloud-based LLMs.

Highlights

• Hybrid AI Proofreading: Supports both cloud-based LLMs and local GGUF models for grammar and text rewriting.
• On-Device Whisper: High-accuracy voice typing that runs locally on the device.
• Integrated OCR: A built-in camera viewfinder and screenshot detection for immediate text extraction.
• Multi-Mode Translation: Seamless switching between offline plugins, ML Kit, and cloud AI providers.
• Productivity Tools: Real-time inline math calculations, a versatile text expander with dynamic variables, and a Gboard-style text editing panel.
• Deep Customization: Zero-latency custom sound packs and multiple layout profiles.