How do you automate repetitive screen tasks?

Start with the system's API or import. If there isn't one, pick by how the task varies: a script or learned program for the same steps, an RPA platform for many automations, an AI agent for tasks that change, or both: the agent does it once and OpenAdapt makes it a program. Check each save another way.

Updated 2026-10-18

How to choose

If the taskConsiderWatch out for
Is covered by an API or importThe APIAccess agreements and fees
Repeats the same steps, and a developer owns itA script: Playwright, Selenium, AutoHotkeyUpkeep when the screen changes
Is one of many to automate across a companyAn RPA platform: UiPath, Power AutomatePlatform cost and an RPA team
Changes each time, or runs a few timesAn AI agentModel fees per run; screens sent to a provider
Repeats, saves data that matters, and should stop on a mismatchA learned program with a record check, such as OpenAdaptIt needs a second way to read the record
Is new now, but will repeatBoth: an AI agent does it once, and OpenAdapt compiles that run into a programTested on synthetic data only so far

Before you automate

  1. Time the task as it's done today, per item.
  2. List where the details come from. OpenAdapt can fill an entry from a PDF, fax image or email (tested on synthetic documents); paper has to be scanned first.
  3. Find a second way to read the saved record.
  4. Decide who approves each save at first, and who answers a stop.

Use an AI agent and a program together

An AI agent can do a new task once, and OpenAdapt compiles its successful run into a program, so later runs make no model calls. An agent can also decide what to enter and call OpenAdapt to make the entry and check it. Both are released and tested on synthetic data. See OpenAdapt vs AI computer-use agents.

Technical details

The agent connection is the OpenAdapt MCP server, started with `openadapt agent serve` (launcher 1.17.0). Compiling an agent's run is the JIT path in openadapt-flow 2.2.0.

Check every save

In our fault test, a screen-only check passed 54 of 72 wrong records, and a full database read caught all 72. How the test worked.

Related: Did it save? · All comparisons

Sources

  1. OpenAdapt fault test, openadapt-flow benchmark/effect_e2e, 2026: faults injected into our own engine on a test record system, 90 runs; 72 left the record wrong. A check of the screen alone passed 54 of those 72; a read-back over the app's REST API passed 9 of them; the full database read caught all 72. A coverage test over a fixed fault list, not a real-world error rate.

See it on your process

Bring one task your team types every day. We'll tell you whether it fits, and what a test on your own system would cover.