HotRiceNoodles/CrossLink

What it solves

CrossLink is a universal LLM API gateway that eliminates provider lock-in by providing a single endpoint for multiple AI models. It solves the problem of managing disparate API formats, authentication methods, and feature sets across different providers like OpenAI, Anthropic, Azure, DeepSeek, and Ollama.

How it works

It acts as a bidirectional protocol translator and proxy. Your application sends requests in either OpenAI or Anthropic format, and CrossLink translates these requests and the resulting streaming responses (SSE) in real-time using a state machine. It manages routing via six different strategies (such as weighted random or least latency) and implements an error-classified failover system that distinguishes between transient errors (like rate limits) and persistent errors (like billing issues) to ensure smarter retries.

Who it’s for

Developers and organizations that use multiple LLM providers and want a unified interface, resilient routing, and centralized control over costs, security, and tool access.

Highlights

• Bidirectional Streaming Translation: Real-time conversion between OpenAI, Anthropic, and Responses API formats, including support for thinking blocks and tool arguments.
• Error-Classified Failover: Uses a DB-backed rule table to prevent "blind retries" by categorizing failures.
• MCP Gateway: A Model Context Protocol gateway featuring per-tool RBAC, tool discovery, and encrypted credentials.
• Pluggable Guardrails: A registry for content-safety engines that can block, log, or mask responses.
• Routing Transparency: Detailed observability via response headers and a routing-distribution API.
• Compliance Ready: Supports Chinese national cryptography (SM2/SM3/SM4) and air-gapped deployment.
• Admin Dashboard: A Vue 3 web UI for managing providers, models, API keys, and usage analytics.