qiantongtech/qData

qData is an open-source data governance and data development platform that integrates ETL, data development, metadata management, data quality, data assets, API services, and AI-powered data Q&A.

What it solves

qData is an enterprise data middle platform that simplifies data governance and development. It addresses the challenge of managing fragmented data across various databases (like MySQL, Oracle, and Doris) by providing a unified system for data integration, quality control, and asset management, while lowering the barrier for non-technical business users to query data using natural language.

How it works

The platform uses a modular architecture to handle the full data lifecycle:

  • Data Integration (ETL): Uses DataX or Spark to ingest, cleanse, and transform data via visual configurations.
  • Data Development: Allows users to create SQL scripts for processing and statistical analysis, scheduled via Quartz or DolphinScheduler.
  • Governance & Modeling: Provides tools for metadata management, data quality auditing (completeness, uniqueness, validity), and data asset cataloging.
  • Data Services: Encapsulates SQL results as API services for external consumption.
  • AI Layer: Implements a Text2SQL engine that converts natural language questions into SQL queries to generate intelligent charts and data answers.

Who it’s for

It is designed for enterprises needing a foundation for data middle platforms, ETL platforms, or data governance systems, as well as data engineers and business analysts who need to efficient data pipelines and AI-powered data retrieval.

Highlights

  • AI-Powered Data Q&A: Natural language interface using Text2SQL to make data accessible to business users.
  • Flexible Execution Engines: Supports both lightweight (DataX) and large-scale distributed (Spark) processing.
  • Comprehensive Governance: Integrated metadata management, data quality checks, and asset tagging in one place.
  • Broad Database Support: Compatible with MySQL, DM8, Oracle, SQL Server, Kingbase8, and Doris.

Related

  • Project
    alldatacenter/alldata

    AllData is a comprehensive data middle-platform that provides an end-to-end suite for data integration, storage, governance, and AI application development.

  • Project
    steedos/steedos-platform

    An AI-native infrastructure that uses a universal metadata standard to enable the instant generation of enterprise software from text descriptions.

  • Project
    datahub-project/datahub

    An open-source metadata management platform that turns enterprise data into trusted context for humans and AI agents through discovery, governance, and observability.

  • Project
    clidey/whodb

    A lightweight, self-hosted database workspace for exploring, editing, and querying data with optional AI-powered natural language interfaces.

  • Project
    open-metadata/OpenMetadata

    An open-source context layer and metadata management platform that provides AI agents and users with the governed business semantics, lineage, and organizational memory needed to understand and trust enterprise data.