misyaguziya/VRCT

VRCT(VRChat Chatbox Translator & Transcription)

What it solves

VRCT addresses the language barrier in social VR environments, specifically VRChat, by enabling real-time translation and transcription of conversations between users who speak different languages.

How it works

The software captures audio from the microphone and speakers, transcribes that audio into text, and translates it. It can then send the translated text directly into the VRChat chat system to facilitate communication.

Who it’s for

Users of VRChat who wish to communicate with people from different linguistic backgrounds, as well as individuals who use the software for other purposes like watching foreign-language movies.

Highlights

  • Real-time Transcription: Converts audio from both the microphone and speakers into text.
  • Translation: Translates transcribed text to bridge communication gaps.
  • VRChat Integration: Sends translated chat messages directly into the virtual environment.

Related

  • Project
    VRCWizard/TTS-Voice-Wizard

    An accessibility tool for VRChat and other environments that converts speech-to-text and text-to-speech, providing real-time translation and avatar integration.

  • Project
    Sharrnah/whispering-ui

    A native desktop application for Windows and Linux that provides a local, offline AI interface for real-time audio transcription, translation, and text-to-speech.

  • Project
    Sharrnah/whispering

    A local, open-source tool for real-time audio transcription, translation, and OCR, designed for streaming overlays and in-game use.

  • Project
    TheDeathDragon/LiveTranslate

    A real-time audio translation tool for Windows that captures system audio and microphone input to provide live translated subtitles via an LLM-powered overlay.

  • Project
    niedev/RTranslator

    RTranslator is a free, offline, real-time translation app for Android. It runs two AI models (Meta's NLLB for translation, OpenAI's Whisper for speech recognition) entirely on-device, so no internet is needed and privacy is preserved. It has three modes: Conversation (two phones connected via Bluetooth translate a live dialogue in both directions), WalkieTalkie (one phone, two people taking turns), and classic text translation. It requires at least 6GB of RAM, supports 31 languages at full quality plus more at reduced quality, and is still in beta with a known Bluetooth-drop bug. Version 3.0 is in development with better translation models and full open-source status.