rpamis/comet

Comet: agent skill harness for turning ideas into evaluated workflows

What it solves

Comet addresses the instability and lack of structure in long-running AI coding tasks. It prevents agents from "forgetting" progress or guessing state after interruptions and replaces intuition-based skill improvement with a scientific evaluation framework. It specifically solves the problem of coordinating complex requirements that are too large for a single agent session by splitting them into manageable, dependency-aware child tasks.

How it works

Comet provides a resumable runtime and a skill platform that integrates with AI coding tools. It offers two primary workflows:

  • Native: Designed for strong models, allowing them to autonomously plan and verify while Comet handles state checks and resumable archiving.
  • Classic: A constrained five-phase methodology (OpenSpec + Superpowers) using a state machine to ensure strict adherence to a specific process.

For complex goals, it uses Supervisor Changes to create a Directed Acyclic Graph (DAG) of child changes, executing them in isolated worktrees via multiple agents before integrating them. It also includes a memory system for personal preferences and project knowledge, and an evaluation platform (comet eval) that uses Rubrics and Pass@k metrics to measure skill performance.

Who it’s for

It is built for developers using AI coding agents (like Claude Code or Cursor) who need to manage complex, multi-step software engineering tasks that require strict verification, resumability, and scientific optimization of their agentic workflows.

Highlights

  • Resumable Workflows: Task state is stored in the project, allowing work to resume exactly where it left off after interruptions.
  • Supervisor Changes: Coordinates multiple agents to implement complex requirements in parallel across isolated worktrees.
  • Dual Workflow Modes: Offers both a flexible "Native" mode for autonomous models and a structured "Classic" mode for high-constraint tasks.
  • Skill Platform: Tools to author, package, and distribute reusable coding skills across 37 different AI coding platforms.
  • Scientific Evaluation: Integrates with LangSmith and LangFuse to evaluate skills using Rubric, Pass@k, and Pass^k scoring.

Related

  • Project
  • Project
  • Project
  • Project
  • Project