SkillOpt: an executive strategy for self-evolving agent skills that optimizes skill documents using deep-learning optimization principles

What it solves

SkillOpt addresses the lack of systematic, reproducible ways to improve agent skills. Most agent skills are currently hand-crafted or generated in a single pass, which often fails to reliably improve over time based on feedback. SkillOpt treats the skill document itself as a trainable state, allowing agents to evolve their capabilities without needing to modify the underlying model weights.

How it works

SkillOpt applies deep-learning optimization principles to textual skill documents. It uses a separate optimizer model to analyze scored rollouts and perform bounded edits (adding, deleting, or replacing text) on a skill document. To ensure stability and progress, it employs a validation gate where candidate edits are only accepted if they strictly improve a held-out validation score. The process includes a textual learning-rate budget, a rejected-edit buffer, and epoch-wise updates. The final output is a compact best_skill.md file that is used during inference with a frozen target model, adding no additional latency or model calls at deployment.

Who it’s for

It is designed for developers of AI agents (such as those using Claude Code, Codex, or Copilot) who want to systematically optimize the performance of their agents across specific benchmarks or tasks without performing expensive model fine-tuning.

Highlights

• Weight-Free Optimization: Improves agent performance by optimizing the skill document rather than the model weights.
• Rigorous Training Loop: Implements a full cycle of rollout, reflection, aggregation, selection, update, and evaluation.
• SkillOpt-Sleep: A nightly offline engine that harvests, mines, and replays past sessions to consolidate validated skills.
• Broad Compatibility: Supports multiple backends (OpenAI, Azure, Claude, Qwen, MiniMax) and integrates with various execution harnesses.
• Zero Inference Overhead: The optimized skill is a static text file, meaning no extra compute is required during deployment.