hydro-project/infinity
An agent runtime and tool protocol for principled agent concurrency
What it solves
Infinity solves the problem of high resource consumption in agentic systems. Traditional agent architectures often keep processes active while waiting for slow tools or external responses, which wastes memory and compute. Infinity allows you to run massive numbers of agents concurrently without the overhead of keeping them constantly active.
How it works
Infinity treats agents as lightweight data structures between turns. When an agent is waiting for a tool or an external event, it "hibernates"—meaning it occupies no stack space and holds no open connections. When a new event arrives, the agent wakes up to process it. This allows the same code to run locally or on serverless platforms like AWS Lambda, where agents can scale to zero when idle.
Who it’s for
Infinity is for developers building complex, concurrent agentic systems who need to manage thousands of agents efficiently on limited hardware or cost-sensitive serverless infrastructure.
Highlights
- Extremely lightweight: Capable of running 75,000 agents on a Raspberry Pi.
- Hibernation model: Agents consume no resources while waiting for tasks or tool outputs.
- Reactive Agent Protocol (RAP): Enables network-based tool usage that works even when the agent process is inactive.
- Serverless-ready: Designed to run seamlessly on platforms like AWS Lambda with scale-to-zero capabilities.
- Built-in coding agent: Includes a specialized agent for concurrent development tasks like running tests and managing parallel edits.
Related
- Project
- Project
- Project
- Project