OpenAdapt.AI
Teach AI to use any software.
Record demonstrations. Train models. Deploy agents.
Show it once. Let it handle the rest.Perform, don't prompt.Works with Claude, GPT-4V, Gemini, and more.Open source. Model agnostic. Run anywhere.
Register for updates (we promise not to spam)
Warning: OpenAdapt is alpha software and comes with absolutely no warranty of any kind.
Getting Started
OpenAdapt is an open-source platform for GUI automation with ML. Record human demonstrations, train models, and deploy agents that can operate any software.
Install in 30 Seconds
One command installs everything you need. No Python setup required.
$curl -LsSf https://astral.sh/uv/install.sh | sh$uv tool install openadapt$openadapt --help
What is uv? - uv is a fast Python package manager that automatically installs Python and manages dependencies.
Quick Start Commands
openadapt capture start --name my-taskStart recordingopenadapt capture stopStop recordingopenadapt capture view my-taskView recordingopenadapt doctorCheck systemPyPI Download Trends
Historical download statistics for OpenAdapt packages
Register for updates (we promise not to spam)
What's Next?
Troubleshooting
The OpenAdapt Ecosystem
13 open-source repositories
Open Source Generative Process Automation (i.e. Generative RPA). AI-First Process Automation with Large ([Language (LLMs) / Action (LAMs) / Multimodal (LMMs)] / Visual Language (VLMs)) Models
OpenAdapt’s open-source ML toolkit for training and evaluating general multimodal GUI-action models.
GUI interaction capture -- production-ready event streams with time-aligned media
PII/PHI detection and redaction for GUI automation data (text, images, dicts)
Evaluation infrastructure for GUI agent benchmarks
Temporal smoothing for UI element detection with OmniParser integration
HTML viewer components for ML dashboards and benchmarks
Multimodal demo retrieval for GUI automation
System tray application for OpenAdapt
Production execution engine for OpenAdapt GUI automation agents. Wraps trained models with safety gates, human-in-the-loop confirmation, session management, and audit logging. Bridges the gap between benchmark evaluation and real-world automation.
Cross-platform desktop app for continuous screen recording and AI training data collection
OpenAdapt Blog - guides, updates, and automation recipes
Canonical Pydantic schemas for computer-use agents: ComputerState, Action, ActionResult, UINode
Developer Automation
Tools that automate development, testing, and communication
AI-powered dev automation: iterative code generation, testing, and PR creation with Telegram approval
Multi-LLM council for consensus-driven AI responses with cross-model review
LLM-powered social media announcements from your git history
Event-driven social media approval bot with Telegram
Ecosystem documentation aggregator and repository maintenance tools (tidy)
Evaluation & Benchmarks
We wrap official benchmarks like Windows Agent Arena in a CLI that handles VM lifecycle, agent execution, and step-by-step inspection — so you can iterate on your agent fast without modifying the original benchmarks.
The benchmark viewer lets you replay every step of an evaluation — screenshots, actions, and execution logs. View on GitHub
Transform Your Industry with OpenAdapt
From demonstration to automation in minutes. Just do the task once and OpenAdapt learns from watching. No prompt engineering. No scripting. No brittle selectors.
Built-in PII/PHI scrubbing keeps your sensitive data safe.
HR
- Boost team productivity in HR operations. Automate candidate sourcing using LinkedIn Recruiter, LinkedIn Talent Solutions, GetProspect, Reply.io, outreach.io, Gmail/Outlook, and more.
Law
- Streamline legal procedures and case management. Automate tasks like generating legal documents, managing contracts, tracking cases, and conducting legal research with LexisNexis, Westlaw, Adobe Acrobat, Microsoft Excel, and more.
Insurance
- Optimize productivity in insurance. Automate policy management, claims processing, data analysis, and document collaboration with PolicyCenter, Xactimate, Excel, SharePoint, PowerBI, and more.
Healthcare
- Advance patient care and streamline operations. Automate revenue cycle management, clinical documentation, and scheduling in Cerner, Epic, and more.
Finance
- Enhance efficiency and compliance in financial services. Automate tasks like data entry, reporting, and portfolio management using tools like Excel, Bloomberg, QuickBooks, and more.
Logistics
- Automate tasks with Transportation Management Systems (TMS), Freight Management Systems (FMS), Load Tracking Systems, and Document Management Systems for efficient tracking, scheduling, and financial record-keeping.
Pharmacy
- Enhance accuracy and inventory management. Automate prescription management, inventory control, medication dispensing, and patient records with Krol (Telus), Filware, Healthwatch, and more.
Customer Support
- Automate customer inquiries, ticket management, collaboration, data analysis, and communication using OracleHCM, Workday, SAP, Excel, SharePoint, Outlook, LinkedIn, Teams, PowerBI, and more.
Sales Development
- Automate repetitive tasks in OracleHCM, LinkedIn, SalesForce, and Gmail for lead generation, prospecting, and communication to optimize revenue growth.
Let us build for you
If OpenAdapt doesn't fully automate your workflow out of the box, we'll work with you to fix that.
Start IntakeBook a 15-minute automation fit call
Tell us your highest-friction workflow and we will map what can be automated first.