ikechan8370/chatgpt-plugin

What it solves

This project provides a comprehensive plugin for Miao-Yunzai and Yunzai-Bot that integrates advanced LLM capabilities into chat bots. It solves the difficulty of managing multiple AI models, handling complex conversation contexts in group chats, and implementing persistent memory or knowledge bases within a bot framework.

How it works

Built with the Chaite core, the plugin acts as a bridge between the bot framework and various AI services. It uses an API server and a pluggable storage layer (defaulting to SQLite) to manage high-concurrency dialogues. It supports multiple model channels, customizable prompts (presets), and a RAG (Retrieval-Augmented Generation) system using vector indexing for both private and group-level memory. It also features a "BYM" (pseudo-human) mode that allows the bot to initiate conversations based on probability or keywords to seem more natural.

Who it’s for

Developers and users of Miao-Yunzai or Yunzai-Bot who want to add sophisticated AI chat features, personalized AI personas, and long-term memory capabilities to their bots.

Highlights

• Multi-Channel Management: Supports load balancing and personalized prompts across different AI models.
• Pseudo-Human Mode: Enables the bot to proactively chat using probability-based triggers and keyword matching.
• Memory & RAG: Built-in vector indexing for group and private memory, allowing the bot to recall past interactions or external knowledge.
• Visual Management: Includes a web-based control panel for managing channels, tools, and triggers, alongside command-line instructions.
• Multimodal Support: Handles text, images, and voice inputs, and can return multimodal responses.