bentoml/BentoDiffusion

BentoDiffusion: A collection of diffusion models served with BentoML

What it solves

It provides a standardized way to self-host and deploy Stable Diffusion family models for generating and manipulating images or video clips from text prompts.

How it works

The project uses the BentoML framework to wrap diffusion models (such as SDXL Turbo, FLUX.1, and SD3.5) into production-ready HTTP services. Users can run these services locally using bentoml serve or deploy them to BentoCloud or custom OCI-compliant infrastructure for scalability.

Who it’s for

Developers and ML engineers who want to deploy diffusion models into production environments without building the serving infrastructure from scratch.

Highlights

  • Support for multiple models including FLUX.1, Stable Diffusion 3.5, and ControlNet.
  • Easy deployment options via BentoCloud or OCI-compliant images.
  • Built-in Swagger UI for immediate interaction with the deployed model.
  • Simple Python client and CURL support for integrating the model into applications.

Related

  • Dispatch
    Deploying DeepFloyd IF with BentoML

    Hugging Face demonstrates how to use BentoML to deploy the DeepFloyd IF text-to-image model, enabling independent scaling of its multi-stage pixel diffusion architecture across multiple GPUs.

  • Dispatch
    Stable Diffusion with Diffusers

    Hugging Face announced how to run the text-to-image Stable Diffusion model using the Diffusers library, providing code, licensing details, and explanations of the model’s latent diffusion architecture.

  • Project
    bentoml/BentoML

    BentoML is a Python library that streamlines turning any AI/ML model into a production‑grade inference API. It provides simple decorators to define services, automatically builds versioned artifacts (Bentos), creates Docker images, and offers performance features like dynamic batching and model parallelism. Ideal for engineers who want reproducible, scalable model serving with minimal DevOps overhead.

  • Project
    Windsander/ADI-Stable-Diffusion

    A C++ library and CLI tool that enables high-performance, Python-free inference for Stable Diffusion models using ONNXRuntime across multiple platforms.

  • Project
    bentoml/OpenLLM

    OpenLLM is a Python tool that lets you run open‑source LLMs (e.g., Llama 3, Qwen 2.5, Mistral) locally and expose them through OpenAI‑compatible REST APIs. With a single command you can start a GPU‑accelerated server, use a built‑in web chat UI, and deploy the service via Docker or Kubernetes. It supports a catalog of models, custom model repositories, and integrates with the high‑performance vLLM backend.