nikkigallery/Whimbox

What it solves

Whimbox is an AI agent designed to automate gameplay for the game "Infinity Nikki." It helps players complete repetitive daily tasks, navigate the world, and perform specific in-game activities without manual effort.

How it works

The system functions as a backend service that combines Large Language Models (LLMs) and image recognition (OCR, YOLO) to interact with the game. It does not modify game files or read memory; instead, it takes screenshots and simulates mouse and keyboard inputs to control the game. It can be controlled via natural language commands or a dedicated app.

Who it’s for

Players of "Infinity Nikki" who have mid-to-high-end PCs and wish to automate daily routines, resource collection, and complex tasks within the game.

Highlights

• Daily Task Automation: Automatically handles activities like material excavation, trials, and weekly quests.
• World Navigation: Supports recording and editing paths for automatic movement and resource gathering (fishing, bug catching, cleaning).
• AI-Driven Control: Allows users to execute functions through natural language dialogue and remote control via WeChat.
• Macro Recording: Ability to record and playback specific operation sequences.
• MIDI Integration: Converts MIDI music scores into scripts for automatic piano playing in-game.