Xilinx/XRT

Run Time for AIE and FPGA based platforms

What it solves

XRT provides a standardized, abstracted software interface to manage and interact with AMD NPUs and FPGAs. This removes the need for developers to write device-specific code for different hardware platforms, allowing software to run across various AMD accelerator hardware like Alveo cards and Versal Adaptive SoCs.

How it works

It operates as a combination of user-space components and kernel drivers. On Linux, it utilizes the accel driver model, and on Windows, it uses the MCDM driver model. It supports both x86_64 and aarch64 CPU architectures and includes a command-line tool called xrt-smi for device configuration and validation.

Who it’s for

Developers working with AMD hardware accelerators, specifically those deploying workloads to NPUs and FPGAs.

Highlights

  • Supports a wide range of AMD hardware including Ryzen, Versal, Alveo, and Zynq UltraScale+ MPSoCs.
  • Cross-platform compatibility with Linux and Windows.
  • Includes xrt-smi for device management and validation.
  • Provides a unified API for seamless access to accelerator hardware.

Related

  • Project
    amd/xdna-driver

    A Linux kernel driver and XRT SHIM library that enables AI inference acceleration on AMD XDNA (NPU) devices for RyzenAI processors.

  • Project
    pykeio/ort

    A Rust interface for hardware-accelerated inference and training of ONNX machine learning models, enabling deployment across various hardware and frameworks.

  • Project
    google-ai-edge/LiteRT

    Google's high-performance on-device runtime for deploying ML and Generative AI models across mobile, web, and IoT platforms with advanced hardware acceleration.

  • Project
    vllm-project/vllm-ascend

    A hardware plugin that allows the vLLM inference engine to run on Huawei Ascend NPUs, supporting a variety of open-source LLMs and multimodal models.

  • Project
    intel/compute-runtime

    An open-source compute runtime providing oneAPI Level Zero and OpenCL driver support for Intel graphics hardware architectures.