HojoAI/Hojo-TTS-Light

Hojo-TTS-Light is a lightweight speech generation model series developed by HojoAI, currently comprising a 0.04B and a 0.08B model.

What it solves

Hojo-TTS-Light is designed to provide high-quality, bilingual (Chinese and English) text-to-speech synthesis that can run on low-power hardware. It addresses the high computational requirements typically associated with advanced TTS models, allowing for efficient deployment on CPUs, ordinary GPUs, and embedded edge devices.

How it works

The project uses a token-LM framework based on a speech tokenizer (consisting of an 18M encoder and a 30M decoder). It offers two model sizes: a 40M parameter model with 15 built-in voices, and an 80M parameter model that supports voice cloning from a few seconds of audio. To ensure high efficiency, the models are provided as optimized ONNX files with KV cache merging, enabling fast CPU-based synthesis.

Who it’s for

Developers and businesses looking to integrate lightweight, bilingual TTS capabilities into their applications, especially those targeting edge devices or those who want to avoid the expensive GPU requirements of larger models.

Highlights

  • Ultra-Lightweight: Core models are only 40M and 80M parameters, maintaining high sound quality (DNSMOS > 4.0).
  • Native Bilingualism: Seamlessly handles Chinese and English without needing to switch branches.
  • On-Device Friendly: Optimized for CPU and embedded devices via ONNX packaging.
  • Pronunciation Correction: Supports the use of Pinyin to manually correct mispronounced polyphonic characters or proper nouns.
  • Voice Cloning: The 80M model allows for quick voice cloning using short audio samples.

Related

  • Project
  • Project
  • Project
  • Project