docling-project/docling-serve

Running Docling as an API service

What it solves

Docling Serve allows users to run Docling—an AI-driven document conversion toolkit—as a scalable API service. This removes the need to integrate the library directly into application code, enabling document conversion to be handled as a standalone network service.

How it works

It wraps the Docling conversion engine in a web server (built with FastAPI), providing a stable v1 API for document processing. Users can send documents via HTTP requests (e.g., using curl or a custom client) and receive converted output. The project provides several deployment options, including a Python package and various container images optimized for different hardware (CPU, CUDA 12.8, CUDA 13.0, and ROCm).

Who it’s for

Developers and organizations that need to integrate high-quality document conversion into their existing software pipelines or deploy the conversion engine in a containerized environment.

Highlights

  • API-First Approach: Provides a stable v1 API and automatic API documentation.
  • Flexible Deployment: Offers specialized container images for CPU and multiple NVIDIA CUDA versions to optimize performance.
  • Interactive Playground: Includes a built-in UI for testing conversions without writing code.
  • Hardware Support: Supports multiple architectures including linux/amd64 and linux/arm64.

Related

  • Project
  • Project
  • Project
  • Project
  • Project