samuel-vitorino/sopro
A lightweight text-to-speech model with zero-shot voice cloning
What it solves
Sopro TTS is designed to provide high-quality, intelligible text-to-speech (TTS) and voice cloning with a very small footprint. It addresses the need for efficient, low-latency audio generation that can run on consumer hardware, such as laptop CPUs or directly in a web browser, without requiring massive GPU resources.
How it works
Sopro uses a lightweight 120M-parameter model (sopro-v2-turbo) that supports zero-shot voice cloning from a short reference audio clip (5-20 seconds). It can operate in two modes: an offline path for maximum quality and a streaming path for minimal latency, achieving a time-to-first-audio of approximately 300ms on a laptop CPU. The model supports English, European Portuguese, French, and German.
Who it’s for
This project is for developers building audio applications that require fast, on-device TTS and voice cloning, as well as those who need to integrate speech synthesis into browser-based environments via ONNX runtime.
Highlights
- Small Footprint: 120M parameters, allowing it to run on laptop CPUs and in-browser.
- Zero-Shot Cloning: Clones voices from 5-20 seconds of reference audio.
- Multi-language Support: Supports English, European Portuguese, French, and German.
- High Efficiency: Low Real-Time Factor (RTF) on M3 CPUs and H100 GPUs.
- Streaming Capabilities: Supports streaming audio generation for real-time interactions.
- Causal Vocoder: Includes a causal vocoder for the streaming path.
Related
- Project
- Project
- Project
- Project
- Project