FlashLabs-AI-Corp/FlashLabs-Chroma

Worlds first open-source real-time end-to-end spoken dialogue model with personalized voice cloning.

What it solves

Chroma 1.0 is designed to enable natural, real-time spoken dialogue between humans and AI. It eliminates the need for separate speech-to-text and text-to-speech systems by providing an end-to-end multimodal model that can understand audio inputs and generate both text and synthesized speech responses simultaneously.

How it works

Chroma is a multimodal causal language model that integrates a reasoner (based on Qwen2.5-Omni-3B), a backbone (Llama3), and a decoder (Llama3), utilizing the Mimi codec for audio processing at a 24kHz sampling rate. It processes auditory inputs directly and can use reference audio prompts to guide the style of the generated speech, enabling personalized voice cloning.

Who it’s for

Developers and researchers looking to build virtual human models or voice-driven AI agents that require low-latency, natural-sounding voice interactions and personalized voice styles.

Highlights

  • End-to-End Spoken Dialogue: Processes audio input and generates audio/text output in a single model.
  • Personalized Voice Cloning: Uses reference audio prompts to mimic specific voice styles.
  • Multimodal Generation: Simultaneously produces coherent text and speech responses.
  • Open-Source: Released under the Apache-2.0 license for community development.

Related

  • Project
    ashbuilds/payload-ai

    A Payload CMS plugin that adds AI‑powered text, image, and voice generation to content fields, supports multiple model providers, and offers fine‑grained configuration and access control.

  • Project
    JasonLiu0826/ackem

    Ackem is a Windows‑only Electron app that turns any OpenAI‑compatible LLM into a persistent, local‑first AI companion. It offers chat, searchable memory, emotional/relationship tracking, optional desktop pet, and an extensible plugin system, while keeping all data (including API keys) on the user’s machine. The project is actively maintained, released under AGPL‑3.0, and requires no Node.js runtime for end‑users.

  • Project
    Shopify/Shopify-AI-Toolkit

    A plugin that equips AI coding assistants (Claude Code, Codex, Cursor, VS Code Copilot, etc.) with Shopify‑specific capabilities: searchable docs, API‑schema lookup, GraphQL/Liquid validation, and store‑management commands, all usable directly from the editor or terminal.

  • Project
    halo-dev/upage

    UPage is an open‑source, Docker‑based platform that uses large language models to turn natural‑language descriptions into fully responsive web pages. It offers a visual editor, multi‑page generation, and export of clean HTML/CSS/JS, and works with any compatible LLM API.