onyx-dot-app/onyx-foss

Open Source AI Platform - AI Chat with advanced features that works with every LLM

Onyx – Open‑source “context layer” for teams and AI agents

Onyx is a self‑hosted platform that gathers data from dozens of workplace apps (Slack, Google Docs, GitHub, etc.), builds a searchable knowledge store, and makes that knowledge available to large language models (LLMs) and AI agents. It is positioned as the “knowledge/context layer” that lets an LLM answer questions with up‑to‑date, private company information instead of only public data.

What the repo provides

  • Core server code (MIT‑licensed) that runs the indexing pipeline, vector/keyword stores, and the API that agents and UI components talk to.
  • Connectors for >50 SaaS applications that pull documents, metadata and permissions into the internal index.
  • Agentic RAG stack – a hybrid vector‑plus‑keyword index plus a custom retrieval‑agent that selects the most relevant chunks for a query.
  • Web UI & desktop client for chatting with the system, creating custom agents, and viewing generated artifacts.
  • Integrations – Slack/Discord bots, a Chrome extension, and an embeddable widget so you can query Onyx from anywhere.
  • Deployment scripts for Docker, Kubernetes, Helm/Terraform and cloud‑provider guides.
  • Two deployment flavours – a full‑featured “Standard” mode (vector store, background workers, model inference) and a lightweight “Lite” mode (just the chat UI, <1 GB RAM, no indexing).

Key capabilities

Feature What it does
Agentic RAG Retrieves the most relevant internal documents and feeds them to an LLM, reducing token usage and improving answer accuracy.
Deep Research Multi‑step workflows that let agents gather, synthesize, and cite information across many sources.
Custom Agents Define agents with a specific knowledge subset, custom prompts, and the ability to invoke actions.
Web Search Optional live web lookup via Serper, Google PSE, Brave, SearXNG, Firecrawl, Exa, etc.
External Actions / MCP Agents can call APIs of connected apps (e.g., create a Jira ticket, update a Notion page) to complete tasks end‑to‑end.
Secure Sandbox Isolated execution environment for running code or processing intermediate artifacts safely.
Artifacts Generate PDFs, images, or other downloadable files as part of a workflow.
Voice Mode Speech‑to‑text and text‑to‑speech interface for hands‑free interaction.
Fine‑grained permissions Role‑based access control, SSO (Google, OIDC, SAML), SCIM provisioning, and audit logs.

Typical use cases

  • Internal Q&A – Employees ask the chat bot about company policies, product specs, or recent project updates and receive answers backed by the latest internal docs.
  • Automated workflows – An agent reads a support ticket, looks up relevant troubleshooting steps, and creates a resolution ticket in the ticketing system.
  • Research reports – The system gathers data from multiple sources, synthesizes a report, and outputs a PDF or slide deck.
  • Developer assistance – Connectors pull code snippets, design docs, and issue trackers so an LLM can answer technical questions with the correct context.

Getting started

# One‑liner install (Docker‑based) provided by the project
curl -fsSL https://onyx.app/install_onyx.sh | bash

After installation you can:

  1. Run the Docker compose stack (or Helm chart for Kubernetes).
  2. Configure connectors to the apps you want to index.
  3. Add your LLM provider (OpenAI, Anthropic, Ollama, etc.) and an embedding model.
  4. Open the web UI (default http://localhost:3000) and start chatting.

Licensing & editions

  • Community Edition (CE) – Fully open source under the MIT license; includes core RAG, chat UI, agents, and most connectors.
  • Enterprise Edition (EE) – Proprietary add‑ons for large organisations (advanced analytics, white‑labeling, extra security controls). The repo only contains the CE; EE features are documented on the commercial site.

Who should look at this repo?

  • Teams that need private, self‑hosted AI assistance and cannot rely on public LLM knowledge bases.
  • Developers who want to build custom AI agents that act on internal tools.
  • Organizations that require data sovereignty, air‑gapped deployments, or strict RBAC.

Bottom line: Onyx is a genuine open‑source platform that stitches together workplace data, a vector/keyword index, and LLMs to deliver fast, context‑aware AI assistance. It ships with connectors, UI, and deployment tooling, making it a practical starting point for building internal AI copilots.

Related

  • Project
  • Project
  • Project
  • Project
  • Project