qualcomm/ai-hub-apps

The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

What it solves

It provides a collection of sample applications and tutorials to help developers deploy machine learning models on Qualcomm devices, specifically optimizing them for on-device execution.

How it works

The repository offers open-source "app recipes" and end-to-end workflow tutorials. These apps leverage various runtimes—including TensorFlow Lite, ONNX, and the Genie SDK—to run models on CPU, GPU, and NPU (Hexagon HTP) compute units across Android, Windows, and Ubuntu platforms.

Who it’s for

Developers looking to implement AI tasks like LLMs, image classification, object detection, and speech-to-text on Snapdragon-powered hardware.

Highlights

  • Broad Hardware Support: Optimized for a wide range of Snapdragon chipsets, including X Elite and 8 Elite series.
  • Multi-Platform: Includes ready-to-use examples for Android, Windows, and Ubuntu.
  • Diverse AI Tasks: Covers a variety of modalities including Generative AI (ChatApps), computer vision (segmentation, super resolution), and audio (Whisper, YamNet).
  • Flexible Runtimes: Supports multiple inference APIs such as TensorFlow Lite, ONNX, and Genie SDK.

Related

  • Project
    qualcomm/ai-hub-models

    A collection of state-of-the-art ML models optimized for Qualcomm devices, featuring tools to compile, quantize, and profile models for on-device deployment.

  • Project
    google-ai-edge/litert-samples

    A collection of official and community samples, model recipes, and deployment tools for LiteRT and LiteRT-LM to enable high-performance on-device ML execution.

  • Project
    Arm-Examples/ML-examples

    A collection of machine learning examples and tutorials for deploying and optimizing AI models on Arm Ethos NPUs and Cortex-based platforms.

  • Project
    amd/RyzenAI-SW

    A suite of tools and runtime libraries for optimizing and deploying AI inference on AMD Ryzen AI-based PCs to maximize hardware acceleration.

  • Project
    dotnet/machinelearning-samples

    A collection of implementation samples and end-to-end applications for .NET developers to integrate machine learning into their apps using the ML.NET framework.