mcp-server

clawdcursor: Transform Screen UI into Stable, Scriptable Elements

Name: clawdcursor: Transform Screen UI into Stable, Scriptable Elements
Author: AmrDab

For founders building automation, clawdcursor merges accessibility data and OCR into a single UI map, letting you run reusable scripts with verified actions and a safety gate.

From the repo · “clawdcursor compiles whatever's on screen into one UI map — accessibility tree and OCR fused into stable, addressable elements, with a screenshot only when needed — then drives apps through reusable scripts, verifying every action and routing it through a single safety gate.”

406 stars+2★ this week59 forksTypeScriptGuide quality 9/10 · reviewed Oct 20Updated 10/22/2026100% free · open source

What it does

Clawdcursor compiles screen content into a UI map and drives apps through reusable scripts, verifying every action for desktop automation

When to use it

•When automating desktop applications with varying screen layouts
•For testing and quality assurance of graphical user interfaces
•To automate data entry or workflows across multiple desktop applications

Ready-to-paste prompt

clawdcursor -a 'My Application' -s 'login' -v

Heads up: Ensure the system has the necessary dependencies installed, including TypeScript and a compatible Node.js version, to successfully compile and run the clawdcursor project

Saves to your device

Use with Claude

New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

⚡ Runs out of the box

A prompt/skill package — nothing to install beyond adding it to your AI tool.

Try it instantly — no install

Claude Code

mkdir -p ~/.claude/skills/clawdcursor && curl -fsSL https://workflowstacks.com/api/skills/clawdcursor/claude-skill -o ~/.claude/skills/clawdcursor/SKILL.md

Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)

claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

How clawdcursor: Transform Screen UI into Stable, Scriptable Elements works

Codeflow

Free to inspect

Clawdcursor: Transform Screen UI into Stable, Scriptable Elements is a very large TypeScript project (~63k lines across 172 code files, plus 182 test files). You install it into your AI tool with one command; there is nothing to run yourself. Last commit this month, MIT license, has a test suite.

Size

Very large codebase

~63k lines · 172 code files · days to read — use, don't read

Setup

Install as a skill / plugin

Add it to Claude Code (or your AI tool) with one command — 2 skills inside. Nothing to run yourself.

Runs on

Inside your AI tool

Helper scripts use Node.js · needs API keys

TypeScript 88%PowerShell 5%Swift 4%Python 2%JavaScript 1%

Where to start reading

1
README.md
Start here — what it does and how to install it
2
SKILL.md
The instructions the AI actually follows
3
src/index.ts
Where the program starts running
4
.env.example
The API keys and settings you must provide

What's in each folder

src/Core code — the actual logic299 files

skills/Prompts, skills & agent definitions1 files

docs/Documentation42 files

scripts/Helper scripts45 files

seed-registry/Folder11 files

native/Folder8 files

.claude-plugin/Plugin manifest — what gets installed2 files

.github/CI / automation (GitHub Actions)10 files

READMEHas testsDocumentedCI checksMIT licenseUpdated this month

Use with Claude

New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

⚡ Runs out of the box

A prompt/skill package — nothing to install beyond adding it to your AI tool.

Try it instantly — no install

Claude Code

mkdir -p ~/.claude/skills/clawdcursor && curl -fsSL https://workflowstacks.com/api/skills/clawdcursor/claude-skill -o ~/.claude/skills/clawdcursor/SKILL.md

Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)

claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

Quick Actions

Details

Creator

AmrDab

Language

TypeScript