tensorflow/lingvo

Lingvo

What it solves

Lingvo provides a modular and scalable framework for building neural networks in TensorFlow, with a specific focus on sequence models and large-scale machine learning tasks.

How it works

It acts as a high-level framework on top of TensorFlow, allowing users to define and train models across various modalities. It supports diverse training environments, including CPUs, GPUs, and CloudTPUs, and enables massive scaling through techniques like model parallelism (as seen in GShard).

Who it’s for

Researchers and developers building complex sequence-to-sequence models, giant language models, or multi-modal 3D object detection systems who require TensorFlow integration and high scalability.

Highlights

  • Broad Model Support: Includes implementations for Automatic Speech Recognition, Machine Translation, Language Modelling, Image recognition (LeNet5), and 3D Object Detection.
  • Scaling Capabilities: Supports giant language models with up to one trillion parameters using GShard and 512-way model parallelism on CloudTPUs.
  • Flexible Installation: Available via pip for quick use or via Bazel for framework development.
  • Multi-modal Integration: Supports advanced tasks like Lidar-Camera deep fusion for 3D object detection.

Related

  • Project
    tensorflow/tensorflow

    An end-to-end open source platform for machine learning that provides a flexible ecosystem of tools and libraries for building and deploying ML-powered applications.

  • Project
    tensorflow/gnn

    A TensorFlow library for building and scaling Graph Neural Networks, featuring tools for heterogeneous graph representation and distributed graph sampling.

  • Project
    google/seqio

    A library for processing sequential data that provides a unified framework for task-based datasets, preprocessing, and evaluation for sequence models.

  • Project
    AIStream-Peelout/flow-forecast

    An open-source deep learning framework for time series forecasting, classification, and anomaly detection featuring a wide array of state-of-the-art models.

  • Project
    TensorSpeech/TensorFlowASR

    A TensorFlow-based framework for Automatic Speech Recognition that implements various ASR architectures and supports TFLite conversion for efficient deployment.