sandroandric/AgentHandover

What if OpenClaw, Claude Code, Codex etc. knew how to do your work without you saying it? AgentHandover observes you, learns and teaches your agents with self-improving skills.

AgentHandover – Turn Your Mac Workflows into AI‑Executable Skills

What it is

AgentHandover is a macOS‑only application that watches how you perform repetitive tasks on your computer, turns each task into a Skill (a structured description of the workflow, its purpose, decision logic, guardrails and your writing style) and makes that Skill available to AI agents such as Claude Code, Codex, OpenClaw, Hermes or any tool that speaks the MCP protocol.

Why it matters

  • No hand‑crafted prompts – you just work as usual; the app records the clicks, keystrokes and screen content.
  • Why‑focused – the generated Skill captures not only the steps but also the strategy (selection criteria, guardrails, voice) that you implicitly use.
  • Continuous improvement – after an agent runs a Skill it reports back; successful runs raise confidence, deviations trigger questions, and you can approve or correct the Skill.
  • Local‑first & private – all recordings, embeddings and the knowledge base stay on your Mac; only you decide if agents may query the stored “Memory”.

Core concepts

Concept What it does
Skill Markdown document describing a workflow: strategy, ordered steps, selection criteria, guardrails, voice, confidence score, and any open questions.
Memory Private, searchable archive of every screen you saw. Screens are embedded with Google’s EmbeddingGemma 2 (via Ollama) and kept as vectors + short redacted description; screenshots are deleted after embedding.
Commonplace Unified search UI (and CLI / REST API) that lets you, or connected agents, query Skills, Memory moments, daily digests and your user profile.
Knowledge ledger Tracks which parts of a Skill are known, hypothesised or unknown and drives the weekly question budget.
MCP server Small local server that mediates communication between AgentHandover and any MCP‑compatible agent.

How it works – the user flow

  1. Install – download the .pkg release, run the onboarding wizard (grants screen‑capture, accessibility, and installs the required Ollama models).
  2. Record a task – click Record in the menu‑bar, perform the workflow once, stop recording.
  3. Answer up to three questions – the app asks what it could not infer (e.g., start condition, end condition, ambiguous step).
  4. Review & approve – a draft Skill appears; you confirm steps, strategy and guardrails, then click Approve for Agents.
  5. Connect an agent – one‑liner agenthandover connect claude-code (or codex, openclaw, hermes). The agent receives the Skill via MCP.
  6. Run – in the agent’s chat you invoke the Skill (/reddit‑community‑marketing or a natural description). The agent executes the steps, reports progress back, and the Skill’s confidence updates.

Example Skill (excerpt)

Reddit Community Marketing
Daily engagement workflow – 6 steps – 4 sessions learned

STRATEGY
Browse target subreddits for posts about marketing tools or growth‑hacking. Engage with high‑signal posts (10+ comments, <48 h old, not promotional). Write authentic replies: acknowledge → share experience → mention product.

STEPS
1. Open Reddit → r/startups
2. Scan posts – skip promotional, skip <10 comments
3. Open high‑signal post, read top comments
4. Write reply: acknowledge → experience → mention product
5. Submit, verify not auto‑removed
6. Repeat for r/marketing, r/growthacking (max 5/day)

SELECTION CRITERIA   GUARDRAILS
- 10+ comments      - Max 5 replies/day
- Not promotional   - Never identical phrasing
- <48 h old         - Never reply to own posts

VOICE & STYLE
Tone: casual, short punchy sentences, occasional emoji.

The Skill also stores the confidence (89 %) and the time it takes (~15 min).

Memory & search (Commonplace)

  • Every screen is embedded with EmbeddingGemma 2 (≈0.5 s per screen).
  • You can search from the menu bar, via agenthandover memory search "invoice from Acme", or let agents query it (agenthandover memory agents on).
  • Screens are kept as tiny encrypted thumbnails for 7 days; vectors and redacted descriptions persist for a year.
  • Privacy zones let you exclude password managers, banking sites, etc., from capture.

Automation use‑cases

  • Research – scan sources, extract facts, draft a summary.
  • Community engagement – daily Reddit/Discord posting with your voice.
  • Support triage – read tickets, pick macros, draft replies.
  • Data extraction – pull structured data from dashboards or spreadsheets.
  • Ops checklists – deployments, releases, status updates.
  • Personal skill library – any repeatable workflow you want an agent to perform.

Installation & quick start (summary)

# 1. Install the .pkg from the GitHub releases page
# 2. Record a task
# 3. Answer the auto‑generated questions
# 4. Approve the draft Skill
# 5. Connect an agent
#    agenthandover connect claude-code
# 6. Run it in Claude Code: /reddit‑community‑marketing

The CLI also offers agenthandover install, agenthandover memory forget, agenthandover search … and list_ready_skills for advanced control.

Privacy & security

  • All data stays on‑device; only you control whether agents may search Memory.
  • Screens are deleted after embedding; thumbnails are encrypted with a Keychain‑stored key.
  • The app respects macOS privacy zones and lets you manually forget or pause Memory capture.

Who is behind it?

Created by Sandro Andrić (BySandro) – see the logo and personal site link in the README. A Discord community is available for support.


Bottom line: AgentHandover is a genuine macOS‑centric tool that converts your repeatable desktop workflows into structured, AI‑readable Skills, stores a searchable visual memory of your work, and lets local AI agents execute those Skills while continuously learning from their runs. It is squarely in the AI‑agent automation space.

Related

  • Project
  • Project
  • Project
  • Project
  • Project