ethz-spylab/agentdojo
A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
What it solves
AgentDojo provides a dynamic environment to evaluate how LLM agents handle prompt injection attacks and the effectiveness of various defenses against them.
How it works
It functions as a benchmark suite that allows researchers to run specific tasks across different suites (such as a workspace suite) using various LLM models, attack strategies (like tool_knowledge), and defense mechanisms (like tool_filter).
Who it’s for
Researchers and developers focusing on the security of LLM agents, specifically those testing for vulnerabilities to prompt injection and evaluating mitigation strategies.
Highlights
- Dynamic evaluation environment for prompt injection attacks.
- Support for multiple LLM models and customizable attack/defense configurations.
- Integration with the Invariant Benchmark Registry for result tracking.