niedev/RTranslator

What it solves

RTranslator provides a free, offline, and privacy-focused real-time translation solution for Android users. It eliminates the need for an internet connection or cloud-based services to translate spoken conversations, allowing users to communicate across language barriers in real-time while keeping all data on the device.

How it works

The app leverages on-device AI models for speech-to-text, translation, and text-to-speech:

• Speech Recognition: Uses OpenAI's Whisper to convert spoken audio into text.
• Translation: Uses Meta's NLLB (No Language Left Behind) or alternatives like Mozilla Bergamot, Madlad 400, and HY-MT in newer versions to translate text between languages.
• Audio Output: Uses the Android system's Text-to-Speech (TTS) engine to read the translation aloud.

It offers three primary modes:

1. Conversation Mode: Connects two or more phones via Bluetooth LE to exchange translated audio and text in real-time.
2. WalkieTalkie Mode: A single-phone mode that detects two languages and translates them sequentially for quick interactions.
3. Text Translation Mode: A standard text-to-text translator.

Who it’s for

Android users who need a real-time translator that works without internet access, prioritizes absolute privacy, and possesses a device with at least 6GB of RAM to handle the on-device AI models.

Highlights

• Fully Offline: All AI processing happens on the phone, ensuring privacy and functionality without data.
• Optimized Performance: Models are converted to ONNX format and quantized to int8 to reduce RAM consumption and execution time.
• Multi-Device Sync: Conversation mode allows seamless translation between multiple connected devices.
• Broad Language Support: Supports a wide array of languages, including a "low quality" setting for additional rare languages.
• Background Operation: Can function while the phone is on standby or while using other apps.