OliBomby/Mapperatorinator
An AI framework for generating and modding osu! beatmaps for all gamemodes from spectrogram inputs.
What it solves
Mapperatorinator automates the creation of high-quality, rankable beatmaps for the game osu! across all gamemodes. It eliminates the manual effort of mapping songs by generating hit objects, timing, and patterns based on audio input, while also providing a tool to identify faults and inconsistencies in existing maps.
How it works
The framework uses a multi-model approach centered on a modified Whisper architecture (219M parameters) that takes Mel spectrograms of audio as input. It converts beatmaps into a tokenized event representation (quantizing time and position) and generates these tokens sequentially. To handle long songs, it uses a sliding window approach with 90% overlap to ensure seamless transitions. For higher precision, it employs a diffusion model to denoise quantized coordinates into final positions and a "super timing generator" that averages multiple inference passes to handle variable BPM.
Who it’s for
- osu! beatmap creators who want to automate the initial mapping process or generate guest difficulties.
- Beatmap modders who want an AI-driven tool (MaiMod) to find rhythmic errors, timing inaccuracies, or inconsistent placements.
- Developers interested in audio-to-event generative models.
Highlights
- Multi-gamemode support: Generates maps for std, taiko, ctb, and mania.
- MaiMod: An AI modding tool that detects "surprisal" (unexpected patterns) to flag potential mapping faults.
- High Customizability: Allows users to specify difficulty (star rating), mapper style (via mapper ID), upload year, and specific style descriptors.
- Context-Aware Generation: Can use existing timing or kiai sections as context to improve accuracy and speed.
- Web and CLI Interfaces: Includes a user-friendly Web GUI and an interactive CLI for configuration.