bentoml/BentoDiffusion

BentoDiffusion: A collection of diffusion models served with BentoML

What it solves

It provides a standardized way to self-host and deploy Stable Diffusion family models for generating and manipulating images or video clips from text prompts.

How it works

The project uses the BentoML framework to wrap diffusion models (such as SDXL Turbo, FLUX.1, and SD3.5) into production-ready HTTP services. Users can run these services locally using bentoml serve or deploy them to BentoCloud or custom OCI-compliant infrastructure for scalability.

Who it’s for

Developers and ML engineers who want to deploy diffusion models into production environments without building the serving infrastructure from scratch.

Highlights

  • Support for multiple models including FLUX.1, Stable Diffusion 3.5, and ControlNet.
  • Easy deployment options via BentoCloud or OCI-compliant images.
  • Built-in Swagger UI for immediate interaction with the deployed model.
  • Simple Python client and CURL support for integrating the model into applications.

Related

  • Dispatch
    Deploying DeepFloyd IF with BentoML

    Hugging Face demonstrates how to use BentoML to deploy the DeepFloyd IF text-to-image model, enabling independent scaling of its multi-stage pixel diffusion architecture across multiple GPUs.

  • Dispatch
    Stable Diffusion with Diffusers

    Hugging Face announced how to run the text-to-image Stable Diffusion model using the Diffusers library, providing code, licensing details, and explanations of the model’s latent diffusion architecture.

  • Project
    bentoml/BentoML

    A Python framework for building and deploying high-performance model inference APIs and multi-model serving systems for any AI/ML model.

  • Project
    Windsander/ADI-Stable-Diffusion

    A C++ library and CLI tool that enables high-performance, Python-free inference for Stable Diffusion models using ONNXRuntime across multiple platforms.

  • Project
    bentoml/OpenLLM

    OpenLLM is a tool for self-hosting open-source LLMs as OpenAI-compatible APIs, providing a simplified workflow for local serving and enterprise cloud deployment.