software-mansion/argent

Argent – AI‑driven control of mobile, TV and desktop apps

What it is

• A command‑line tool that lets an AI assistant (e.g., ChatGPT, Claude) interact directly with iOS simulators, Android emulators/devices, Apple/Android/Fire TV, and Electron/Chromium apps.
• It bridges the gap between natural‑language instructions and UI actions such as taps, swipes, typing, hardware‑button presses, and mouse/keyboard input.

Key capabilities

Area	What Argent does
Interaction	Simulate taps, swipes, gestures, typing, D‑pad navigation on TVs, and mouse/keyboard events on desktop apps.
End‑to‑end testing	Record a sequence of UI actions once and replay it deterministically for bug repros or smoke tests.
Visual regression	Capture a screenshot baseline, then diff it against a live capture with OCR‑ and font‑aware comparison.
Profiling	Hook into Hermes, React DevTools, Xcode Instruments, Perfetto to surface render timings, CPU hotspots, and hangs.
Debugging	Stream logs, intercept network traffic (XMLHttpRequest, axios, fetch, Expo), evaluate JS in the app, and inspect native/React component trees.
React Native support	Build, launch, and iterate on RN apps without extra configuration.

How you use it

# Initialise the tool in a project (npm or pnpm)
npx @swmansion/argent@latest init   # pnpm: pnpm dlx @swmansion/argent@latest init

After installation you can ask your AI assistant commands like:

• “Tap the login button on the iPhone simulator.”
• “Record a path that reproduces this crash.”
• “Show me a visual diff of the home screen.” The assistant translates the natural‑language request into the appropriate CLI call, which Argent executes on the target device.

Documentation & privacy

• Full docs are hosted at docs.swmansion.com/argent covering installation, supported platforms, CLI reference, and editor integrations.
• Telemetry is opt‑out (argent telemetry disable). A short privacy notice explains what data is collected.

License model

• The source code is Apache‑2.0 licensed.
• Platform‑specific binaries (simulator-server, ax-service, .dylib files) are proprietary to Software Mansion and may only be used within Argent. Redistribution or reverse‑engineering of those binaries is prohibited.

Who’s behind it

• Developed by Software Mansion, a long‑standing agency and core contributor to React Native. They also offer consulting and custom development services.

Who might benefit

• Teams building AI‑powered assistants that need to manipulate mobile or TV UIs.
• QA engineers who want a single CLI to record and replay UI flows across iOS, Android, and desktop.
• Developers looking for integrated profiling, visual‑regression, and debugging tools that can be driven programmatically.

---

All information is taken directly from the repository’s README.