itigges22/ATLAS

Adaptive Test-time Learning and Autonomous Specialization

What it solves

ATLAS enables compact, open-source LLMs to perform complex software engineering tasks locally. It solves the problem of smaller models lacking the inherent reasoning and reliability of frontier models by surrounding the model with a system for planning, candidate generation, verification, and iterative repair, all while running on consumer-grade hardware without relying on external APIs.

How it works

ATLAS implements a multi-layered architecture to enhance model performance:

  • V3 Pipeline: Transforms a single prompt into a verified solution using constraint-driven planning (PlanSearch), diverse candidate sampling (DivSampling), and iterative self-correction via PR-CoT Repair and refinement loops.
  • Geometric Lens: An energy-based scoring system that uses the model's own embeddings and an XGBoost ensemble to predict candidate quality without needing an external oracle.
  • Atlas-Proxy: A Go-based orchestrator that manages tool-call routing, enforces output grammar via GBNF schemas, and applies bias mitigations to steer the model toward structural edits.
  • Sandbox: An isolated execution environment where generated code is compiled, linted, and tested across multiple languages (Python, Rust, Go, C, etc.) before being accepted.
  • Local Inference: Uses llama-server for GPU-accelerated quantized inference, supporting NVIDIA, AMD, Apple Silicon, and Vulkan.

Who it’s for

Developers who want a private, self-hosted coding agent that runs on their own hardware (requiring 16GB+ VRAM) and those who prefer using smaller, open-weight models for software development without per-token costs or data privacy concerns.

Highlights

  • Local-First: Fully self-hosted with no requirement for third-party API keys.
  • Verification Loop: Compiles and tests code in a sandbox to ensure correctness before delivery.
  • Hardware Agnostic: Supports a wide range of GPUs including NVIDIA CUDA, AMD ROCm, Apple Metal, and Vulkan.
  • Native TUI: Includes a Bubbletea-based terminal interface for chatting and monitoring the pipeline in real-time.
  • Model-Agnostic: Allows users to bring their own GGUF models and retrain the Geometric Lens on their own workloads.

Related

  • Project
  • Dispatch
  • Project
  • Project
  • Project