dominostars/playtranslate

What it solves

PlayTranslate is an Android application designed to help gamers and language learners translate screen text in real-time. It eliminates the need to manually type text into a translator, allowing users to translate dialogue in games, visual novels, and manga, or even real-world text via the camera, while maintaining their experience.

How it works

The app uses Optical Character Recognition (OCR) to capture and read text from the screen or camera. It then processes this text through various translation engines. Users can choose between offline translation models (like ML Kit or specialized NMT engines) or plug in API keys for high-quality online services such as DeepL, OpenAI, Gemini, and Claude.

Who it’s for

• Gamers who want to play games in languages they don't fully understand.
• Language learners who want to use games as a medium for learning, utilizing features like word lookup, Furigana/Pinyin hints, and Anki flashcard exports.

Highlights

• Real-time Translation: Supports one-tap or automatic translation as dialogue changes.
• Linguistic Tools: Includes word lookup with dictionary definitions, reading hints (Furigana/Pinyin), and text-to-speech.
• Offline Capabilities: Offers on-device OCR and translation models for use without internet.
• Linguistic Integration: Integrates with Yomitan dictionaries and allows direct export of sentences to AnkiDroid.
• Flexible Capture: Supports custom capture regions and works across dual-screen or split-screen Android devices.
• Camera Translation: Live translation of real-world text using a planar tracker.