OpenDriveLab/RISE

What it solves

RISE addresses the high cost and laborious reset processes associated with real-world robot interactions. It provides a framework for robot policies to improve themselves through simulated experiences (imagination) rather than relying solely on physical hardware interactions.

How it works

RISE uses a compositional world model consisting of a controllable multi-view dynamics model and a progress value model. This setup allows the system to generate imaginary rollouts—simulated sequences of actions and outcomes—which are then used to train and bootstrap robot policies via online reinforcement learning.

Who it’s for

Researchers and developers working on robotic manipulation and reinforcement learning who want to scale policy improvement without the need for constant physical resets or expensive hardware wear.

Highlights

• Compositional World Model: Combines dynamics and progress value models to provide informative advantages for policy training.
• RL in Imagination: Enables scalable self-improvement by training policies in a simulated environment created by the world model.
• Real-world Gains: Demonstrated significant performance increases in dexterous tasks like brick sorting (+35%), backpack packing (+45%), and box closing (+35%).