Crawlee: Reliable Web Scraping
Use Crawlee to automatically visit lots of websites in your Node.js projects.
"A solo developer, building a product recommendation platform, can use Crawlee to pull product details from Amazon and Home Depot websites by setting up a few lines of code and configuring the library's settings. They can then integrate this data with their custom AI model. By doing this, they can provide accurate and up-to-date product information to their customers."
- β’When you need to extract data from websites that use JavaScript rendering
- β’When you want to automate browser interactions for data extraction or testing
- β’When you need to download files from websites in a scalable and reliable way
const { Crawlee } = require('crawlee'); const crawler = new Crawlee.Crawler({ puppeteer: { launchOptions: { headless: false } } }, async ({ page, statusCode }) => { await page.goto('https://www.example.com'); const title = await page.title(); console.log(title); }); await crawler.run();Skip the builder β one click puts this in Claude, Cursor, Antigravity and more.
Installs with a command or two; your AI agent can do it for you.
mkdir -p ~/.claude/skills/crawlee && curl -fsSL https://workflowstacks.com/api/skills/crawlee/claude-skill -o ~/.claude/skills/crawlee/SKILL.mdOpens the app with this repo with the prompt ready to go β no copy-paste needed.
Crawlee: Reliable Web Scraping is a very large TypeScript project (~75k lines across 1309 code files, plus 231 test files). Setup is light: installs like a normal app. Reading the code is optional. Last commit this month, Apache-2.0 license, has a test suite.
- 1README.mdStart here β what it does and how to install it
- 2package.jsonDependencies and the commands it exposes
Skip the builder β one click puts this in Claude, Cursor, Antigravity and more.
Installs with a command or two; your AI agent can do it for you.
mkdir -p ~/.claude/skills/crawlee && curl -fsSL https://workflowstacks.com/api/skills/crawlee/claude-skill -o ~/.claude/skills/crawlee/SKILL.mdOpens the app with this repo with the prompt ready to go β no copy-paste needed.
Are you the creator of this tool? Claim your listing β and earn 85% of every sale.
Related skills
More devtools tools founders pair with this one.