mcp-server

crawl4ai-mcp-llm

Name: crawl4ai-mcp-llm
Author: laurentvv

Web crawling tool that integrates with AI assistants via the MCP

45 stars17 forksPythonUpdated 10/19/2026100% free · open source

What it does

Runs a local MCP‑compatible server that lets you send a URL and get back a structured, LLM‑enhanced crawl of the page.

When to use it

•You need to feed fresh web content into a ChatGPT‑style assistant without writing custom scraper code.
•Your workflow already talks to MCP services and you want a plug‑and‑play crawler instead of building one from scratch.
•You want the crawler to return clean text, detected language, and extracted metadata (title, headings, links) in one JSON call.

Ready-to-paste prompt

mcp call crawl {"url": "https://blog.openai.com/chatgpt-plugins", "extract": ["title", "meta_description", "links"]}

Heads up: The server requires Python 3.9+; on older versions it will crash at import time. Verify `python --version` before installing.

Saves to your device

Use with Claude

New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

✅ Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly — no install

Claude Code

mkdir -p ~/.claude/skills/crawl4ai-mcp-llm && curl -fsSL https://workflowstacks.com/api/skills/crawl4ai-mcp-llm/claude-skill -o ~/.claude/skills/crawl4ai-mcp-llm/SKILL.md

Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)

claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

top-level files

folders

2.7M

source size

MIT

license

Key files

AGENTS.md

README_PYPI.md

README.md

File tree

.github/

assets/

lang/

src/

tests/

.gitattributes

.gitignore

AGENTS.md

CHANGELOG.md

LICENSE

PLAN.md

pyproject.toml

README_PYPI.md

README.md

uv.lock

Use with Claude

New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

✅ Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly — no install

Claude Code

mkdir -p ~/.claude/skills/crawl4ai-mcp-llm && curl -fsSL https://workflowstacks.com/api/skills/crawl4ai-mcp-llm/claude-skill -o ~/.claude/skills/crawl4ai-mcp-llm/SKILL.md

Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)

claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

Quick Actions

Details

Creator

laurentvv

Language

Python