iimeta/fastapi
企业级 LLM API 快速集成系统，支持OpenAI、Azure、文心一言、讯飞星火、通义千问、智谱GLM、Gemini、DeepSeek、Anthropic Claude以及OpenAI格式的模型等，简洁的页面风格，轻量高效且稳定，支持Docker一键部署。
What it solves
This project provides a unified API gateway for integrating multiple Large Language Model (LLM) providers. It eliminates the need for developers to write separate integration logic for every different AI model provider, reducing development and maintenance costs by allowing a single API standard to access various models.
How it works
The system acts as a proxy layer that supports a variety of providers including DeepSeek, OpenAI, Azure, Gemini, Anthropic Claude, and several Chinese LLM providers (such as Qwen, Ernie Bot, and Zhipu GLM). It provides an OpenAI-compatible API interface, allowing users to integrate once and switch between different models seamlessly.
Who it’s for
Developers and enterprises that need to integrate multiple LLMs into their business systems without managing the complex, varying APIs of each individual provider.
Highlights
- Broad Provider Support: Supports a wide range of global and regional LLM providers.
- OpenAI-Compatible: Uses a unified API standard based on the OpenAI format.
- Docker Support: Supports one-click deployment via Docker, as well as cluster and multi-region deployment.
- Complete Ecosystem: Includes a separate web interface, admin panel, and SDK for comprehensive management.
Related
- Project
- Project
- Project
- Project