sybil-solutions/local-studio
Control panel for VLLM, Sglang, llama.cpp, exllamav3
Local Studio – A desktop UI for self‑hosted LLMs
What it is
- A thin fork of the open‑source T3 Code application that adds first‑class support for running your own large language models locally.
- Provides a graphical “agent UI” where you can chat with models, run tool calls, view threads, and manage source‑control‑style sessions.
- Bundles a local controller that discovers any inference server on the machine (vLLM, SGLang, llama.cpp, or any server exposing an OpenAI‑compatible
/v1/modelsendpoint) and re‑exports it under a single OpenAI/Anthropic‑compatible gateway. - Enables a fleet of machines linked via Tailscale so a model loaded on any computer in your private network can be used from any other, with one‑click installation of the controller on Linux/macOS hosts.
- Ships with extra providers – Pi and Oh My Pi – that run alongside popular hosted models (Claude, Cursor, Grok, etc.) and support streaming, tool calls, interrupt, rollback, and token‑usage tracking.
Why it matters
- Lets developers, researchers, or hobbyists keep their data and models in‑house while still getting a polished desktop experience similar to commercial AI‑assistant tools.
- The Tailscale‑based fleet makes it easy to pool GPU resources across several machines without writing custom networking code.
- By re‑exporting local inference servers as standard OpenAI endpoints, existing libraries and tools that expect the OpenAI API can be used unchanged.
Getting started
- Download the installer for your OS from the latest GitHub release (DMG for macOS,
.exefor Windows, AppImage or.debfor Linux). - Run the installer – macOS builds are signed/notarized; Windows builds currently require a SmartScreen confirmation.
- After launch, log in to at least one agent CLI (e.g.,
pioromp) so the desktop can discover the local controller. - Open Settings → Local to see any other machines on your Tailscale network. Click Connect if a controller is already running, or Install to have Local Studio automatically install a controller via SSH on a Linux/macOS host.
- Choose a provider (Pi, Oh My Pi, or any OpenAI‑compatible server) and start a chat or run a script.
Developer workflow
- Requires Node 24, pnpm 11, and Bun 1.3.14.
- Install dependencies with
pnpm install. - Run the controller alone:
pnpm --filter @local-studio/controller start. - Launch the desktop in dev mode (hot‑reload) with
pnpm dev:desktop --port 18773 --home-dir .t3. - For production use, build then start:
pnpm build:desktop && T3CODE_HOME="$PWD/.t3" pnpm start:desktop. - The repository enforces a 4 000‑line source budget (
node scripts/local-check.mjs) to keep the fork lightweight and easy to merge upstream changes.
Release process
- CI builds signed macOS DMGs, Windows NSIS installers, and Linux AppImages/
.debpackages for both x64 and arm64. - Controller binaries and update manifests are also published.
License
- MIT license, same as the upstream T3 Code project. The additional Oh My Pi components have their own license in
assets/OMP-LICENSE.txt.
Bottom line: Local Studio is a practical, open‑source desktop front‑end for self‑hosted LLMs, with built‑in multi‑machine fleet management via Tailscale, making it a solid choice for anyone who wants the convenience of a modern AI assistant while keeping the inference stack under their own control.
Related
- Project
- Project
- Project
- Project
- Project