Klad: A Paint and Animation App for AI Agent Collaboration
Understanding Klad: Agent-Driven Artistry
Klad is a 2D painting and animation application designed for human-agent collaboration, where an AI agent interacts with the canvas via a command-line interface. Unlike traditional generative AI models that output static pixels, Klad treats every brushstroke, fill, and shape as editable data. This allows users to refine, recolor, or animate specific elements of a drawing long after they have been created, providing a level of control that pixel-based image generators cannot match.
How It Works: The Agent-Human Workflow
Klad functions by exposing its internal tools to coding agents (such as Claude Code or Codex) through a command-line interface. The workflow typically follows these steps:
- Prompting: The user provides a natural language request to the agent, such as asking for a specific character or scene element.
- Execution: The agent uses
kladcommands to paint stroke-by-stroke, which appear in the editor in near real-time. - Collaboration: The user can pin notes on the canvas or manually select and edit any stroke or shape created by the agent.
- Refinement: Because the drawing is stored as a series of operations (JSON), users can perform precise adjustments, such as bending a mouth, blending a blush, or modifying the timing of an animation, without needing to regenerate the entire image.
Why It Differs from Generative Models
Klad avoids the "reroll" problem inherent in diffusion-based image models. Because the output is a collection of vectors, paths, and pressure-sensitive strokes, the drawing remains a structured document. Users are not restricted to the initial output; they can treat the agent's work as a starting point for further manual refinement. This makes it particularly useful for game development, where consistency, rigging, and sprite sheet generation are required.
Key features include:
- Full Painting Suite: Brushes with pressure sensitivity, layers, masks, and clipping.
- Animation Tools: A timeline with onion skinning, keyframe support, and inverse kinematics (IK) for rigging.
- Game-Ready Exports: Ability to export directly to PNGs, sprite sheets, or Godot-compatible formats.
- Git-Friendly: Drawings are stored as folders of plain files, making version control straightforward.
Community Insights and Use Cases
Early adopters have highlighted the potential for Klad to bridge the gap between conceptualization and final assets. Users have experimented with complex tasks, such as creating walk cycles for characters, noting that the ability to maintain palette control and precise rigging is a significant advantage over traditional in-painting techniques.
One user noted the shift in perspective regarding AI-driven graphics:
"I still think these are early days, and LLM-driven graphics are only going to improve. And there are obvious advantages to a procedural system with rigging: Much easier to maintain consistency, palette control, and the ability to make precise alterations without having to deal with any kind of conventional in-painting nonsense."
Another user emphasized the utility for hobbyist game development:
"I have been meaning to find/build a tool that would sit in between the pre-production assets of a movie clip... and the moment you press generate. I envisioned it as some sort of a flipbook that would allow me to cheaply get a low-res idea of what the 'generate' click would get me."
Technical Status and Availability
Klad is currently in an early, source-available state. It is built using Rust and requires users to compile from source. While it currently offers the best experience on macOS, it supports Linux and Windows, though some platform-specific features like pen pressure are still in development. The project is licensed under the PolyForm Internal Use License 1.0.0, allowing free use for personal projects and smaller companies, with paid licenses required for larger commercial entities.