nihui/qwenimage-ncnn-vulkan

ncnn implementation of Qwen-Image-2.1, with text-to-image, image editing, multi-reference image input and transparent RGBA output

What it solves

This project provides a high-performance, portable implementation of the Qwen-Image-2.1 model, allowing users to generate and edit images on a wide range of hardware without requiring heavy dependencies like Python, PyTorch, or CUDA.

How it works

It uses the ncnn universal neural network inference framework and Vulkan for GPU acceleration. This allows the model to run on NVIDIA, AMD, Intel, and Apple Silicon GPUs across Windows, Linux, and macOS. It supports full BF16 precision without quantization and implements automatic memory management (tiling and low-VRAM modes) to fit the model into as little as 2GB of VRAM.

Who it’s for

Users who want to run Qwen-Image-2.1 for image generation and editing on consumer-grade hardware, especially those who prefer standalone executables over complex environment setups.

Highlights

  • Broad Hardware Support: Works on NVIDIA, AMD, Intel, and Apple Silicon GPUs, as well as CPUs.
  • Versatile Image Tasks: Supports text-to-image, image editing, and transparent RGBA output.
  • Advanced Controls: Includes support for ControlNet (pose, canny, etc.), LoRAs, and up to 10 reference images for multi-reference input.
  • Portable: Distributed as a standalone executable with no Python or CUDA dependencies.
  • Optimized Performance: Includes a Turbo version (8-step generation) and supports dynamic output resolutions.

Related

  • Project
  • Project
  • Project
  • Project