thanhkeke97/RSTGameTranslation

🎮 Real-time Game Translation Tool | OCR + AI Translation | Windows Gaming | Open Source

What it solves

RSTGameTranslation provides real-time translation for video games, allowing players to understand foreign-language text and speech in real-time without leaving the game window. It solves the problem of manually translating game dialogue and menus by automating the capture and translation of on-screen text.

How it works

The tool uses a combination of AI-powered Optical Character Recognition (OCR) to capture text from a selected screen area, and Large Language Models (LLMs) or translation services to translate that text. It also features Speech-to-Text (STT) to recognize speech from game audio and translate it. For accessibility and convenience, it can output the translated text as an overlay or in a chat window, and use Text-to-Speech (TTS) to read the translated text aloud.

Who it’s for

Gamers who play games in languages they don't understand, and users who want to integrate AI-powered translation and voice synthesis for their gaming experience.

Highlights

  • Multiple AI Backends: Supports a wide range of translation services including Gemini, Groq, ChatGPT, Google Translate, and local options like Ollama and LM Studio.
  • Crosstalk Recognition: Includes smart recognition for game context and character name detection.
  • Versatile TTS: Offers four TTS backends, including a 100% local, offline multilingual TTS (Supertonic) supporting 31 languages.
  • Flexible Display: Provides an overlay and chat window for translated text.
  • Speech-to-Text: Can recognize and translate speech directly from game audio.

Related

  • Project
    bquenin/interpreter

    An offline screen translator for Japanese retro games that uses OCR and local LLMs to provide real-time English subtitles via a floating overlay.

  • Project
    HIllya51/LunaTranslator

    A visual novel translator that extracts game text via HOOK or OCR and translates it using LLMs or other engines for a more accessible gaming experience.

  • Project
    ramjke/Translumo

    A real-time screen translator that uses OCR and machine learning to translate text from PC games and applications directly on the screen.

  • Project
    SakiRinn/LiveCaptions-Translator

    A real-time audio translation tool for Windows 11 that integrates Windows Live Captions with LLM and traditional translation APIs to provide translated subtitles via a transparent overlay.

  • Project
    ciddwd/overlay-translator

    Screen Translator is an Android app that captures the screen, runs OCR, translates the text (via on‑device models, LLM APIs, or traditional MT services), and overlays the result back onto the screen. It supports real‑time translation, batch image processing, word‑level dictionary lookup, TTS, and extensive customization, with both offline and cloud options.