OpenAI Five Benchmark

OpenAI Five Benchmark Overview

OpenAI Five is a reinforcement learning agent designed to play Dota 2. OpenAI announced a benchmark match scheduled for August 5, 2018, to test the agent's capabilities against human players in the 99.95th percentile of skill.

Technical Updates and Game Mechanics

OpenAI Five has been updated to incorporate more complex game mechanics and a larger variety of characters. These improvements were made possible by the general nature of the "Rapid" training system, which allows for the integration of new features and randomizations.

Expanded Hero Pool and Capabilities

The agent's hero pool has been increased to 18 heroes, including:

• Axe, Crystal Maiden, Death Prophet, Earthshaker, Gyrocopter, Lich, Lion, Necrophos, Queen of Pain, Razor, Riki, Shadow Fiend, Slark, Sniper, Sven, Tidehunter, Viper, and Witch Doctor.

Additionally, the system has been updated to include the ability to handle wards and Roshan, mechanics that were previously restricted.

Game Restrictions

To accommodate the remaining unintegrated features, the match will be played under the following restrictions:

• Items: No Divine Rapier, Bottle, Quelling Blade, Boots of Travel, Tome of Knowledge, or Infused Raindrop.
• Mechanics: No summons, illusions, or the use of Scan.
• Couriers: Five invulnerable couriers are used, with a prohibition on exploiting them for scouting or tanking.
• Invisibility: No invisibility consumables or relevant items.

Human-Level Reaction Time

OpenAI increased the reaction time of OpenAI Five from 80ms to 200ms. This adjustment was made to bring the agent's reaction time closer to human levels. OpenAI reports that the agent's strength is derived from teamwork and coordination rather than raw reflexes.

Match Event Details

The benchmark match took place on August 5, 2018, in San Francisco. The event featured a best-of-three series against 99.95th percentile Dota players, following a series of "for fun" audience games.