tensorflow/model-optimization

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

What it solves

It provides a suite of tools to optimize machine learning models, making them more efficient for deployment and execution.

How it works

The toolkit uses techniques such as quantization and pruning for sparse weights to reduce model size and improve performance. It includes stable Python APIs and specific integrations for Keras.

Who it’s for

It is designed for both novice and advanced users who need to optimize their models for deployment.

Highlights

  • Quantization support
  • Pruning for sparse weights
  • Dedicated APIs for Keras
  • Stable Python APIs

Related

  • Project
    SonySemiconductorSolutions/mct-model-optimization

    A model compression toolkit for PyTorch and Keras that optimizes AI models for edge deployment using quantization, pruning, and hardware-aware optimization.

  • Project
    PrunaAI/pruna

    A model optimization framework that uses compression algorithms like quantization and pruning to make AI models faster, smaller, and cheaper to run.

  • Project
    vllm-project/llm-compressor

    LLM Compressor is a Python library that quantizes and prunes large language models into the `compressed‑tensors` format, enabling memory‑efficient deployment with vLLM. It supports many low‑precision formats (NVFP4, FP8, INT4, etc.), several PTQ/GPTQ algorithms, DDP and disk‑offloading for huge models, and ships pre‑quantized checkpoints for popular LLMs.

  • Project
    fairlearn/fairlearn

    A Python package that provides metrics and algorithms to assess and mitigate unfairness and bias in AI systems.

  • Project
    rasbt/mlxtend

    A Python library providing machine learning extensions for data science tasks, including ensemble methods, feature selection, and visualization utilities.