BillionsBobby/JevRouter

What it solves

JevRouter prevents AI agents from wasting reasoning tokens on the simple but critical question of "which tool or capability should handle this next?" It replaces expensive reasoning models with a fast, specialized decision model (Jev) to handle routing decisions, while keeping the reasoning model for execution and fallback.

How it works

JevRouter acts as an integration layer between an agent and a set of capabilities (models, subagents, MCP tools, CLIs, and plugins). It uses the Jev API to turn structured state into typed decisions with probability distributions.

Key mechanisms include:

• Routing and Planning: route handles single decisions, while plan determines a sequence of capabilities for multi-step tasks using serial, batch, or decompose strategies.
• Decision Contract: Jev provides the decision probabilities, while JevRouter enforces availability, permissions, risk levels, and confirmation requirements.
• Two-Stage Routing: If the number of candidates exceeds a limit, the router first performs a coarse Top-K filter and then a final choice.
• Capability Discovery: It can automatically discover tools from local Skill directories, MCP server configurations, CLI help commands, and DSH plugin manifests.

Who it’s for

Developers building AI agents who need a fast, low-cost, and auditable way to route requests to the correct tool or sub-agent without consuming excessive LLM tokens.

Highlights

• Unified Routing Contract: One interface for models, subagents, Skills, MCP tools, CLIs, and plugins.
• Decision-Only Mode: No tool is executed implicitly; high-risk capabilities require explicit confirmation.
• Auditable Receipts: Append-only decision and plan files with provenance hashes for full auditability.
• Multi-step Planning: Supports beam sequence selection and diversity penalties to optimize multi-step tool sequences.
• Local Dashboard: A read-only local dashboard for monitoring routing statistics and latency without uploading data.
• SDK and CLI: Provides a comprehensive SDK and CLI for easy integration into agents like Codex and Claude Code.