Light-Heart-Labs/DreamServer

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

What it solves

ODS (Osmantic Deployment System) simplifies the complex process of setting up a private, local AI server. Instead of manually configuring multiple separate tools for inference, chat interfaces, and automation, ODS provides a single-command installation that wires together a complete ecosystem of AI services on your own hardware.

How it works

ODS uses an automated installer that detects your GPU (NVIDIA, AMD, Intel Arc, or Apple Silicon) and selects the most appropriate LLM based on your available VRAM/RAM. It deploys a pre-wired stack of services using Docker and native binaries, including:

  • Inference: llama-server for high-performance local LLM execution.
  • Interface: Open WebUI for a ChatGPT-like experience.
  • Agents & Automation: n8n for workflows, Hermes Agent for autonomous tasks, and OpenCode for AI coding.
  • Knowledge: Qdrant (vector DB) and SearXNG for RAG and private web search.
  • Creative: ComfyUI for image generation.
  • Voice: Whisper (STT) and Kokoro (TTS).

It features a "Bootstrap Mode" that downloads a tiny model first so users can start chatting in under two minutes while the full model downloads in the background.

Who it’s for

Individuals, researchers, and developers who want a sovereign, private AI homelab or workstation without needing deep technical expertise in CUDA drivers or Docker configuration.

Highlights

  • One-Command Setup: Automated hardware detection and installation for Linux, macOS, and Windows.
  • Full-Stack Integration: Pre-integrates inference, RAG, agents, voice, and image generation out of the box.
  • Hardware Optimized: Tailored model selection for a wide range of hardware tiers (from 8GB CPU fallback to 90GB+ VRAM).
  • Extensible Architecture: Services are treated as extensions, allowing users to easily add or disable components via a CLI.
  • Privacy-First: Runs entirely locally by default, ensuring data and prompts remain on the user's machine.