pengzhendong/streaming-sensevoice

Pseudo Streaming SenseVoice with Hotwords

What it solves

It enables real-time, streaming audio transcription by processing inference in chunks using the SenseVoice model. This removes the need to wait for an entire audio file to be processed before receiving text output.

How it works

The project implements a streaming wrapper around the SenseVoice model. It provides three ways to handle audio: processing pre-recorded wav files, capturing audio directly from a microphone, and utilizing a WebSocket service (built with FastAPI) to transmit audio chunks in MP3 format from a browser to a server for low-latency transcription.

Who it’s for

Developers looking to integrate real-time speech-to-text capabilities into their applications using the SenseVoice model.

Highlights

  • Real-time transcription from microphone input.
  • WebSocket-based server for browser-based audio streaming.
  • Support for wav file transcription.
  • Integration with the Recorder library for efficient audio transmission.

Related

  • Project
  • Project
  • Project
  • Project