szczyglis-dev/py-gpt

Desktop AI Assistant powered by GPT-6, GPT-5, Gemini, Claude, Grok, Ollama, DeepSeek, Perplexity, and more - chat, agents, tools, MCP, plugins, RAG, vision, voice, image and video generation, speech synthesis and speech recognition, web search, memory, presets, canvas, assistants, themes, computer use. Windows, Linux, and Mac.

What it solves

PyGPT is a comprehensive desktop AI assistant that provides a unified interface for interacting with a wide variety of AI models (both cloud-based and local). It eliminates the need to switch between different provider websites or terminals, offering a powerful local environment for chat, agentic workflows, and multimodal interactions.

How it works

PyGPT acts as a local client that connects to AI providers via their native SDKs (OpenAI, Google, Anthropic, xAI) or OpenAI-compatible APIs. It integrates LlamaIndex for RAG (Retrieval-Augmented Generation) and supports local model execution through Ollama. The application includes a plugin system, a built-in Python/OS tool for code execution, and a node-based builder for custom agent workflows.

Who it’s for

It is designed for users who want a professional, feature-rich AI desktop application that supports multiple model providers, local LLMs, and advanced automation capabilities without requiring deep AI-model expertise.

Highlights

  • Broad Model Support: Compatible with GPT-6 Astra, Claude, Gemini, Grok, DeepSeek, and local models via Ollama.
  • Multi-Agent Workflows: Supports Chat, Orchestrator, and Swarm runtimes for delegating tasks to specialist workers.
  • Integrated RAG: Built-in LlamaIndex support for indexing and querying various file formats (PDF, CSV, DOCX, etc.) and webpages.
  • Multimodal Capabilities: Includes real-time voice (speech-to-text and text-to-speech), vision/camera input, and image/video generation.
  • Extensible Tooling: Features a plugin system, Model Context Protocol (MCP) support, and a built-in Python/IPython interpreter for system command execution.

Related

  • Project
    AndraxDev/speak-gpt

    An open-source AI assistant client for Android and web that allows users to connect multiple LLM providers using their own API keys.

  • Project
    appleboy/CodeGPT

    CodeGPT is a Go‑based CLI that uses LLM APIs (OpenAI, Azure, Gemini, Anthropic, Ollama, Groq, OpenRouter, LiteLLM) to auto‑generate Conventional‑Commit messages and short code‑review summaries. It installs a Git `prepare‑commit‑msg` hook, supports many providers, proxy settings, language translation, streaming output, and a flexible prompt/template system. Install via Homebrew, Chocolatey, an install script, pre‑compiled binary, or `go install`. Configure API keys (or dynamic helpers), choose models, and customize prompts. Ideal for developers who want AI‑assisted commit messages and quick reviews directly from the terminal.

  • Project
    OpenMOSS/AnyGPT

    AnyGPT is an open‑source multimodal LLM (text, speech, images, music) that uses discrete tokenisation to unify all modalities. It provides base and chat checkpoints, inference scripts, and the AnyInstruct dataset for training and zero‑shot multimodal tasks.

  • Project
    Significant-Gravitas/AutoGPT

    AutoGPT is an open‑source platform for building, deploying, and managing autonomous AI agents. Users can describe a goal in plain English or assemble a workflow visually; the system creates an LLM‑driven agent that interacts with 45+ integrations (Gmail, Slack, GitHub, etc.) to complete tasks such as drafting reports, triaging incidents, or generating marketing copy. The project offers a paid hosted service and a free self‑hostable Docker appliance, with the core platform under a Polyform Shield license and the classic agent code under MIT.

  • Project
    kardolus/chatgpt-cli

    ChatGPT CLI is a cross‑platform command‑line client for many LLM providers. It offers streaming queries, thread‑based chat history, prompt‑file injection, multimedia I/O, and an experimental agent mode (ReAct / Plan‑Execute) that can run shell/file/web‑search tools under budget and policy constraints. It also supports the Model Context Protocol (MCP) for custom tool calls. Install via Homebrew or a pre‑built binary, configure API keys in `~/.chatgpt-cli/config.yaml`, and start chatting with `chatgpt "your question"` or `chatgpt --interactive`.