google-deepmind/open_spiel

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

What it solves

OpenSpiel is designed to provide a unified framework for research in reinforcement learning (RL) and search/planning in games. It eliminates the need for researchers to reimplement common game environments and algorithms, providing a standardized way to test and compare different AI agents across a wide variety of game types.

How it works

The framework represents games as procedural extensive-form games. The core API and the games themselves are implemented in C++ for performance, while providing Python bindings for ease of use. It supports a vast array of game structures, including single- and multi-agent systems, zero-sum, cooperative, and general-sum games, as well as games with perfect or imperfect information.

Who it’s for

It is primarily intended for researchers and developers working on general reinforcement learning, multi-agent RL, and search/planning algorithms in game-based environments.

Highlights

  • Diverse Game Support: Supports everything from traditional grid worlds and social dilemmas to complex sequential games with simultaneous moves.
  • Multi-Agent Capabilities: Handles n-player games with various cooperation and reward structures.
  • Unified API: Provides a consistent interface for both C++ and Python users.
  • Analysis Tools: Includes built-in tools to analyze learning dynamics and common evaluation metrics.

Related

  • Project
    Unity-Technologies/ml-agents

    A toolkit that turns Unity games and simulations into environments for training intelligent agents using reinforcement and imitation learning.

  • Project
    leigest519/OpenGame

    An open-source agentic framework that uses a specialized LLM and a dual-skill system to generate fully playable, end-to-end web games from a single text prompt.

  • Project
    TextArena/TextArena

    A framework of over 100 text-based games used for benchmarking and training LLMs to improve their reasoning and strategic capabilities.

  • Project
    Farama-Foundation/Gymnasium

    A standard Python API and environment suite for developing and comparing reinforcement learning algorithms.

  • Project
    ServiceNow/BrowserGym

    An open-source framework that provides a unified interface for researching and evaluating web agents across multiple benchmarks and open-ended web tasks.