ROCm/AMDMIGraphX

AMD's graph optimization engine.

What it solves

AMDMIGraphX is a graph inference engine designed to accelerate the execution of machine learning models on AMD hardware. It optimizes the process of running a trained model (inference) to ensure higher performance and efficiency.

How it works

It functions as an inference engine that leverages the ROCm ecosystem. It supports reading ONNX files (via Protobuf) and provides both C/C++ and Python APIs for integration. The engine utilizes several low-level AMD libraries, including MIOpen, rocBLAS, and HIP, to execute operations on the GPU.

Who it’s for

This tool is primarily for developers and machine learning engineers who need to deploy and optimize ML models for high-performance inference on AMD GPUs.

Highlights

  • Graph-based acceleration: Specifically designed to speed up ML model inference.
  • Broad integration: Works with the ROCm software stack.
  • Flexible APIs: Offers both Python bindings and C/C++ APIs for application development.
  • Multiple build options: Supports installation via binaries, CMake, or Docker containers.

Related

  • Project
    microsoft/onnxruntime

    A cross-platform machine learning accelerator that optimizes inference and training for models from various frameworks like PyTorch and TensorFlow.

  • Project
    rapidsai/cugraph

    A collection of GPU-accelerated graph analytics packages that enable the creation and manipulation of graphs and the execution of scalable graph algorithms.

  • Project
    InfiniTensor/InfiniTensor

    A high-performance inference engine for GPUs and AI accelerators that enables efficient model deployment and academic validation.

  • Project
    amd/RyzenAI-SW

    A suite of tools and runtime libraries for optimizing and deploying AI inference on AMD Ryzen AI-based PCs to maximize hardware acceleration.

  • Project
    inisis/OnnxSlim

    A tool for simplifying and slimming ONNX models to reduce operator count and improve inference speed while maintaining accuracy.