techjarves/Portable-Local-Studio
Portable local AI studio for Windows, Linux, and macOS. Zero-setup GUI for Image Generation, GGUF LLMs, Text to Speech & Speech to Text
What it solves
Portable AI Studio provides a zero-configuration, 100% offline environment for running multiple AI modalities on a single machine. It eliminates the need for complex environment setups, cloud subscriptions, and internet connectivity, allowing users to generate images, chat with LLMs, and process speech privately on their own hardware.
How it works
The project bundles several high-performance C++ backends into a self-contained runtime. It uses a web-based GUI to manage these engines, which are mutually exclusive by default to optimize VRAM and RAM usage. It automatically detects hardware to apply the best acceleration method available:
- Image Generation: Powered by
stable-diffusion.cppsupporting CUDA, ROCm, Vulkan, Metal, and OpenVINO. - Text Chat: Powered by
llama.cppfor GGUF models. - Speech-to-Text: Powered by
whisper.cpp. - Text-to-Speech: Powered by
kokoro-jsusing the Kokoro-82M ONNX model.
Who it’s for
It is designed for users on Windows, Linux, and macOS (Apple Silicon) who want a private, uncensored AI studio without needing to manage Python environments or API keys.
Highlights
- Zero-Install Portability: Includes its own Node.js runtime and pre-compiled binaries to avoid global system changes.
- Multi-Modal Integration: Unifies image generation, LLM chat, transcription, and voice synthesis in one interface.
- Hardware Auto-Detection: Supports a wide range of accelerators including Nvidia (CUDA), AMD (ROCm/Vulkan), Intel (Vulkan/OpenVINO NPU), and Apple (Metal).
- Integrated Model Manager: Allows users to import weights via Hugging Face URLs or local drag-and-drop.
Related
- Project
- Project
- Project
- Project