gemelo-ai/vocos

Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis

What it solves

Vocos is a neural vocoder designed to synthesize high-quality audio waveforms from acoustic features (such as mel-spectrograms or EnCodec tokens). It aims to bridge the gap between time-domain and Fourier-based neural vocoders, providing a fast, high-fidelity reconstruction of audio.

How it works

Unlike traditional GAN-based vocoders that model audio samples in the time domain, Vocos generates spectral coefficients. These coefficients are then converted into audio waveforms using an inverse Fourier transform, allowing the model to generate audio in a single forward pass for rapid reconstruction.

Who it’s for

This tool is for researchers and developers building audio synthesis systems, text-to-speech (TTS) pipelines, or integrating with other audio models like Bark.

Highlights

  • Fast Synthesis: Generates waveforms in a single forward pass.
  • Spectral Domain Modeling: Uses spectral coefficients and inverse Fourier transform instead of time-domain modeling.
  • GAN-based Training: Trained using a Generative Adversarial Network objective.
  • Flexible Input: Supports reconstruction from both mel-spectrograms and EnCodec tokens.

Related

  • Project
  • Project
  • Project
  • Project