prajwalshettydev/UnrealGenAISupport

Unreal Engine plugin for LLM/GenAI models & MCP UE5 server. OpenAI GPT-5, Deepseek R1, Claude Opus/Sonnet, Gemini 3, Grok 4, Alibaba Qwen, Kimi, ElevenLabs TTS, Inworld, OpenRouter, Groq, GLM, Ollama, Local, Meshy, Tripo, Hunyuan3D, Rodin, fal, Dashscope, Seedream. NPC AI, agentic, chat, 3D gen, TTS, multimodal, image gen. UnrealMCP/UnrealClaude

What it solves

This plugin removes the integration layer complexity for game developers using Unreal Engine, allowing them to easily incorporate various Generative AI models (LLMs) into their games or editor workflows without building the API connections from scratch.

How it works

It provides a C++ and Blueprint-accessible interface to connect Unreal Engine to multiple AI providers. It supports standard chat and structured output requests. Additionally, it implements the Model Control Protocol (MCP), which allows external AI clients (like Claude Desktop or Cursor) to directly control the Unreal Engine editor by spawning objects, modifying materials, and running Python scripts.

Who it’s for

Game developers and technical artists using Unreal Engine 5.4 to 5.7+ who want to integrate agentic NPCs, AI-driven scene generation, or AI-assisted editor automation.

Highlights

  • Multi-Provider Support: Integration with OpenAI, Anthropic Claude, XAI Grok, and DeepSeek.
  • Model Control Protocol (MCP): Enables external AI agents to manipulate the UE scene, generate Blueprints, and execute console commands.
  • Blueprint & C++ Support: AI functionality is accessible via both high-level Blueprints and low-level C++ code.
  • Structured Outputs: Supports OpenAI's structured output feature for receiving data in specific JSON schemas.
  • Cross-Platform: Compatible with Win64, Linux, Mac, Mobile, and Consoles.

Related

  • Project
    ChiR24/Unreal_mcp

    EngineWire is a native Unreal Engine plugin that lets LLM‑based assistants (Claude, Cursor, VS Code, etc.) control the editor through a single MCP tool called `unreal`. It exposes ~400 actions—spawning actors, editing Blueprints, building materials, running Play‑In‑Editor, taking screenshots, and more—via a simple search/describe/execute flow over either a local HTTP server (port 3000) or a Node.js stdio proxy (port 8090). Security is token‑based and localhost‑only by default. Install the plugin, enable the server, add the token to your AI client, and you can issue natural‑language commands that the plugin translates into Unreal‑Editor operations.

  • Project
    unrealcv/unrealcv

    A plugin for Unreal Engine that enables computer vision researchers to build virtual worlds and interact with them using external AI frameworks like PyTorch and TensorFlow.

  • Project
    kevinpbuckley/VibeUE

    An MCP expansion and AI editor toolset for Unreal Engine 5.8+ that enables AI agents to perform deep world-building, animation, and performance profiling within the editor.

  • Project
    CoplayDev/unity-mcp

    MCP for Unity is an MIT‑licensed Unity package that connects LLMs (Claude, Codex, Gemini, local models, etc.) to the Unity Editor via the Model Context Protocol. It lets you create scenes, edit C# scripts, manage assets, run tests, and build games using natural‑language prompts from any MCP client. Install via Unity’s Package Manager, configure detected AI clients, and start issuing commands like “add a cube with a Rigidbody.” The project includes 50 ready‑made tool actions, multi‑instance routing, remote server support, and extensive documentation, with community channels on Discord and GitHub.

  • Project
    simonw/llm-openrouter

    A plugin for the LLM CLI utility that enables access to a wide variety of AI models hosted by OpenRouter, including support for vision, structured outputs, and hosted server tools.