espressif/esp-brookesia

What it solves

ESP-Brookesia provides a full-stack development platform for AIoT (Artificial Intelligence of Things) and HMI (Human-Machine Interface) products. It simplifies the creation of complex embedded devices by decoupling hardware from software, allowing developers to build apps that can run across different hardware forms and interaction surfaces without rewriting core logic.

How it works

The platform is organized as a series of ESP-IDF components across several architectural layers:

• Hardware Abstraction Layer (HAL): Unifies device access and supports both real ESP devices and PC simulation for faster development.
• Service Framework: A plugin-based system for function routing and event management, including specific bridges (MCP) to connect LLM capabilities to device functions.
• Runtime and GUI: Supports multiple app runtimes (JavaScript, Lua, WebAssembly, ELF) and a JSON-driven declarative GUI model.
• System Framework: Integrates the GUI, runtime, and services to manage the overall app lifecycle and system state.
• App Ecosystem: Implements an app-store mechanism for publishing, distributing, and installing apps on devices.

Who it’s for

It is designed for developers building AI-powered IoT devices and smart interfaces who need a scalable way to manage hardware differences and deploy dynamic applications.

Highlights

• Multi-Runtime Support: Ability to run apps written in JS, Lua, WASM, or ELF.
• AI Integration: Dedicated agent managers and adapters for OpenAI, Coze, and XiaoZhi, plus AI-driven emote management for anthropomorphic interactions.
• MCP Bridge: A utility that registers device services as Model Context Protocol (MCP) tools for LLM invocation.
• PC Simulation: Allows for validation and development on a PC before deploying to physical hardware.