workflowstacks
mcp-server

Scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
89,193 stars+1,303★ this week9,198 forksPythonUpdated 10/22/2026100% free · open source
What it does

Scrapling lets you turn a single URL or a whole site into structured data with a few CLI commands, handling pagination, JS rendering, and data extraction automatically.

When to use it
  • •You need to pull product listings, pricing or reviews from a competitor’s site without writing a custom scraper.
  • •You have to harvest public data from a paginated directory (e.g., startup databases, event listings) on a schedule.
  • •You want a quick proof‑of‑concept that can handle JavaScript‑heavy pages and then scale to a full crawl.
Ready-to-paste prompt
python -m scrapling run my_job.yaml --output startups.json --concurrency 5 --max-pages 200
Heads up: Scrapling relies on Playwright's Chromium; if Chromium isn’t installed or your environment blocks headless browsers (e.g., on some corporate servers), the crawl will fail – run `playwright install chromium` and ensure the process can launch a headless browser.
Saves to your device
Use with Claude
New

Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.

✅ Light setup

Installs with a command or two; your AI agent can do it for you.

Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/scrapling && curl -fsSL https://workflowstacks.com/api/skills/scrapling/claude-skill -o ~/.claude/skills/scrapling/SKILL.md
Open in another AI app

Opens the app with this repo with the prompt ready to go — no copy-paste needed.

Connect the whole catalog (MCP)
claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

How Scrapling works
Codeflow
Free to inspect

Scrapling is a large Python project (~17k lines across 64 code files, plus 62 test files). Setup is light: runs with Docker. Last commit this month, BSD-3-Clause license, has a test suite.

Size
Large codebase
~17k lines · 64 code files · ~2 h to skim
Setup
Light setup
Runs with Docker.
Runs on
Python · Docker
No API keys detected
Python 100%
Where to start reading
  1. 1
    README.md
    Start here — what it does and how to install it
  2. 2
    scrapling/cli.py
    Where the program starts running
  3. 3
    pyproject.toml
    Dependencies and the commands it exposes
  4. 4
    scrapling/__init__.py
    Inside scrapling/ — the main logic begins here
What's in each folder
scrapling/Core code — the actual logic59 files
agent-skill/Prompts, skills & agent definitions28 files
docs/Documentation59 files
tests/Tests — proof it works63 files
images/Images & static assets20 files
.github/CI / automation (GitHub Actions)11 files
READMEHas testsDocumentedCI checksDocker readyBSD-3-Clause licenseUpdated this month
Quick Actions
Details
Creator
D4Vinci
Language
Python
Category
mcp-server
Published
10/13/2024

Are you the creator of this tool? and earn 85% of every sale.

Show it off in your README:

Featured on WorkflowStacks
[![Featured on WorkflowStacks](https://workflowstacks.com/api/badge/scrapling.svg)](https://workflowstacks.com/skills/scrapling?utm_source=github&utm_medium=badge)
🔥 Hot this week, in your inbox
Skills like this, every Monday.

The five fastest-growing open-source AI skills, ranked by GitHub star growth. One email a week, unsubscribe anytime.

Do this with a working workflow

Pages we wrote and tested that put a skill like this to work — importable n8n templates, outcome guides and Claude Desktop configs.

MCP config

Playwright (browser) MCP config

Drive a real browser for testing and automation from Claude.

Related skills

More mcp-server tools founders pair with this one.

mcp-server★ 365,609
Rea: Reverse Engineer Apps
Inspect apps down to binary level with Rea. For founders needing code clarity.
mcp-server★ 156,480
open-webui: Self‑hosted AI Chat UI for Faster LLM Integration
Launch a sleek, web‑based AI interface that works with Ollama, OpenAI API, and more—ideal for founders needing a quick, customizable LLM front‑end. 153k+ GitHub stars.
mcp-server★ 132,268
graphify
Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex, and Gemini CLI: local deterministic AST parsing, every edge explained, no vector store.
mcp-server★ 4,534
CISO Assistant: Simplify Compliance
Get a one-stop-shop GRC platform for risk management and compliance. Used by founders, 4.2k+ GitHub stars
mcp-server★ 262
nextclaw: Local AI Workspace
Get a self-hosted AI workspace for automation and messaging. For founders needing local-first AI tools.
mcp-server★ 310
Containarium
Open-source agent runtime — SSH-native isolation, eBPF egress policy, Kubernetes + LXC backends, GPU passthrough, MCP-native CLI