Robbyant/lingbot-vla

What it solves

LingBot-VLA is a Vision-Language-Action (VLA) foundation model designed to provide a pragmatic, high-performance approach to robotic control. It addresses the challenge of creating models that can generalize across different robot configurations and perform tasks with high success rates in both simulation and real-world environments.

How it works

The model is pre-trained on a massive dataset of 20,000 hours of real-world data from nine different dual-arm robot configurations. It is available in two versions: a standard version and a depth-distilled version that incorporates depth information to improve performance. The codebase is optimized for training efficiency, offering a 1.5x to 2.8x speedup over existing VLA codebases and reduced GPU memory usage.

Who it’s for

This project is intended for robotics researchers and developers who want to deploy VLA models on physical robots or in simulations (such as RoboTwin 2.0), and those looking for efficient post-training pipelines for custom robot data.

Highlights

• Large-scale Pre-training: Trained on 20,000 hours of data across 9 robot configurations.
• High Efficiency: Significant training speedups and reduced GPU memory consumption.
• Depth-Aware Options: Provides both depth-free and depth-distilled model checkpoints.
• Strong Benchmarks: Achieves state-of-the-art results on GM-100 and RoboTwin 2.0 benchmarks.
• LeRobot Integration: Fully compatible with LeRobot v3.0 for data handling and deployment.