e2b-dev/desktop

What it solves

E2B Desktop Sandbox provides a secure, isolated virtual desktop environment specifically designed for "Computer Use" by AI agents. It allows developers to give AI models the ability to interact with a full desktop GUI, launch applications, and perform tasks in a sandboxed environment without risking the host machine.

How it works

Built on top of the E2B Sandbox infrastructure, the project uses a Linux-based environment with the Xfce desktop manager. It provides Python and JavaScript SDKs that allow an AI agent or developer to programmatically control the desktop via mouse clicks, keyboard input, and bash commands. The environment can be streamed to a URL for real-time monitoring or screenshots can be taken for the AI to perceive the screen.

Who it’s for

Developers building AI agents that need to operate a computer like a human (e.g., using a web browser, VS Code, or other GUI applications) in a secure, isolated way.

Highlights

• Full GUI Control: Programmatic access to mouse movements, clicks, double-clicks, drags, and keyboard typing/combinations.
• Application Management: Ability to launch specific applications (like Google Chrome or Firefox) and manage window IDs and titles.
• Real-time Streaming: Stream the entire desktop or specific application windows to a URL, with options for password protection and view-only mode.
• Customizable Templates: Users can build their own custom sandbox templates to include specific dependencies or different desktop environments.
• Sandbox Isolation: Each sandbox is isolated from others, ensuring security andes stability.