devtools
Test AI with Langwatch
Evaluate LLMs and AI agents with Langwatch, a platform for founders working with AI technologies
3,525 stars365 forksTypeScriptGuide quality 9/10Updated 9/8/2026100% free · open source
What it does
Langwatch evaluates and tests Large Language Models (LLMs) and AI agents to help founders assess their performance and capabilities.
When to use it
- •When selecting an LLM for a specific task or project
- •When comparing the performance of different LLMs or AI agents
- •When testing and fine-tuning LLMs or AI agents for a particular use case
Ready-to-paste prompt
langwatch --llm gpt-3 --task text-classification --dataset my-dataset.json
Heads up: Langwatch requires a GitHub personal access token to fetch LLM models, which must be stored in a .env file at the root of the project
Saves to your device
Use with Claude
New
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
🔑 Needs an API key
Works after you add credentials — the setup agent will ask you for them.
Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/langwatch && curl -fsSL https://workflowstacks.com/api/skills/langwatch/claude-skill -o ~/.claude/skills/langwatch/SKILL.mdOpen in another AI app
Opens the app with this repo with the prompt ready to go — no copy-paste needed.
Use with Claude
New
Skip the builder — one click puts this in Claude, Cursor, Antigravity and more.
🔑 Needs an API key
Works after you add credentials — the setup agent will ask you for them.
Try it instantly — no install
Claude Code
mkdir -p ~/.claude/skills/langwatch && curl -fsSL https://workflowstacks.com/api/skills/langwatch/claude-skill -o ~/.claude/skills/langwatch/SKILL.mdOpen in another AI app
Opens the app with this repo with the prompt ready to go — no copy-paste needed.
Details
Creator
langwatch
Language
TypeScript
Category
devtools
Published
9/9/2023
Are you the creator of this tool? Claim your listing → and earn 85% of every sale.
Related skills
More devtools tools founders pair with this one.
devtools★ 175,381
Scale web data with firecrawl
Get web data at scale with firecrawl.
devtools★ 112,319
browser-use: Automate Web Tasks
Founders use browser-use to automate online tasks with ease, ideal for startups needing AI-powered browser automation.
devtools★ 95,478
Puppeteer: Automate Browsers
Get browser automation with Puppeteer.
devtools★ 94,927
Playwright: Simplify Web Testing
Get easy cross-browser testing with Playwright, ideal for startup founders and developers
devtools★ 78,834
Crawl4ai
Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
devtools★ 70,437
Streamline IT with Ansible
Deploy and maintain apps with ease using Ansible, a simple automation platform, ideal for founders and dev teams.