thanhkeke97/RSTGameTranslation

🎮 Real-time Game Translation Tool | OCR + AI Translation | Windows Gaming | Open Source

What it solves

It enables gamers to translate in-game text and audio in real-time, removing language barriers for games that lack native translations or support for the user's preferred language.

How it works

The tool captures a selected area of the game screen and uses Optical Character Recognition (OCR) to extract text. This text is then sent to an AI translation service (either cloud-based or local) and displayed as an overlay or in a chat window. It also includes speech-to-text for game audio and text-to-speech (TTS) to read translations aloud.

Who it’s for

Gamers on Windows 10+ who play games in languages they do not understand and want real-time translations without leaving the game.

Highlights

  • Multiple OCR Engines: Supports OneOCR, Windows OCR, PaddleOCR, EasyOCR, and RapidOCR.
  • Diverse Translation Backends: Integrates with Gemini, Groq, ChatGPT, Google Translate, and local options like Ollama and LM Studio.
  • Local TTS: Features Supertonic for free, offline, multilingual text-to-speech across 31 languages.
  • Audio Integration: Includes speech-to-text functionality to recognize and translate spoken game dialogue.

Related

  • Project
    HIllya51/LunaTranslator

    A visual novel translator that extracts game text via HOOK or OCR and translates it using LLMs or other engines for a more accessible gaming experience.

  • Project
    Sharrnah/whispering

    A local, open-source tool for real-time audio transcription, translation, and OCR, designed for streaming overlays and in-game use.

  • Project
    SakiRinn/LiveCaptions-Translator

    A real-time audio translation tool for Windows 11 that integrates Windows Live Captions with LLM and traditional translation APIs to provide translated subtitles via a transparent overlay.

  • Project
    sxzxs/Real-time-translation-typing

    A real-time translation and speech-to-text tool for Windows that allows users to type or speak and have the result translated and entered directly into applications.

  • Project
    TheDeathDragon/LiveTranslate

    A real-time audio translation tool for Windows that captures system audio and microphone input to provide live translated subtitles via an LLM-powered overlay.