RLinf/RPent

RPent: Agentic Infrastructure for the Physical World

What it solves

RPent addresses the challenge of making embodied agents (robots) more reliable and capable of handling long-horizon manipulation tasks. It solves the limitation where frozen Vision-Language-Action (VLA) models alone often struggle with complex tasks by wrapping them in an agentic framework that provides reasoning, memory, and self-evolution capabilities.

How it works

RPent is a recursive agent framework that treats various AI capabilities—perception, reasoning, memory, execution, and self-evolution—as composable services. It uses an "Agentic Planner" (such as Claude Code or Codex) to steer frozen VLA models, treating the VLAs as reliable manipulation primitives. The system operates through a loop of continuous interaction, reflection, and adaptation, allowing the agent to acquire new capabilities and evolve beyond its initial design through memory-guided interaction.

Who it’s for

  • Embodied intelligence researchers focusing on high success rates in long-horizon manipulation tasks.
  • Online and reinforcement learning researchers studying self-evolving agents and memory-distillation loops.
  • Robotics application developers who need a standardized, service-oriented architecture to deploy solutions on real hardware (e.g., Franka arms).
  • End users who want to run predefined robotic tasks out-of-the-box without needing deep machine learning expertise.

Highlights

  • Broad Compatibility: Supports multiple simulators (LIBERO-PRO, RoboCasa, RoboTwin, RoboDojo) and real-world hardware (Franka single and dual-arm).
  • Harness VLA: Specifically designed to steer frozen VLAs into reliable manipulation primitives.
  • Recursive Evolution: Enables agents to evolve through reflection and recursive interaction with the physical world.
  • Developer Tooling: Includes an interactive CLI for live steering and a Live Dashboard for streaming reasoning, camera views, and action timelines.

Related

  • Project
  • Project
  • Project
  • Project
  • Project