Ichigo3766/Open-Relay

What it solves

Open Relay provides a high-performance, native iOS and iPadOS experience for users of self-hosted Open WebUI servers. It replaces the mobile web browser experience with a polished, system-integrated app that allows users to interact with their private AI models on the go.

How it works

Built with 100% SwiftUI and Swift 6, the app acts as a native client that connects to an Open WebUI server via Server-Sent Events (SSE) for real-time streaming. It integrates with Apple's CallKit for AI voice calls and uses MLX Swift for on-device speech-to-text (Qwen3 ASR) and text-to-speech (Marvis Neural Voice), ensuring that voice processing happens locally on the device.

Who it’s for

Users who self-host Open WebUI and want a native Apple ecosystem app (iPhone, iPad, Apple Watch) with deep system integration, such as Home screen widgets, Action Button shortcuts, and iPad-specific layouts.

Highlights

• Native Voice Integration: AI voice calls via CallKit with live animated orb visualization.
• On-Device ML: Offline TTS and STT using MLX Swift.
• Advanced Chat Interface: Support for Markdown, Mermaid diagrams, SVGs, and collapsible reasoning blocks for chain-of-thought models.
• System Integration: Custom URL schemes for automation via Raycast, Apple Shortcuts, and Home Assistant.
• RAG & Organization: Native support for knowledge bases (using # trigger) and folder-based organization with per-folder system prompts.
• Crosspoint Capabilities: Terminal integration for direct AI access to the server terminal and rich HTML embeds for interactive tools.