devtools

Test AI with Langwatch

Name: Test AI with Langwatch
Author: langwatch

Evaluate LLMs and AI agents with Langwatch, a platform for founders working with AI technologies, backed by 3.3k+ GitHub stars

3,318 stars324 forksTypeScriptQuality 9/10Updated 7/1/2026100% free · open source

About this skill

The platform for LLM evaluations and AI agent testing

Topics

analytics

datasets

dspy

evaluation

gpt

llm

llm-ops

llmops

low-code

observability

openai

prompt-engineering

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

top-level files

folders

239.2M

repo size

Apache-2.0

license

Key files

Dockerfile.langy_agent

package.json

README.md

File tree

.chainlit/

.claude/

.coderabbit/

.githooks/

.github/

.semgrep/

agentic-e2e-tests/

assets/

bullboard/

charts/

clickhouse-serverless/

cmd/

dev/

docs/

langevals/

langwatch/

mcp-server/

packages/

pkg/

python-sdk/

scripts/

sdk-go/

services/

skills/

Quick Actions

Details

Creator

langwatch

Language

TypeScript

Related skills

More devtools tools founders pair with this one.

devtools★ 356,398

Grow with developer-roadmap

Get interactive guides for your team with developer-roadmap. For founders seeking dev growth tools.

devtools★ 226,735

Boost dev skills with the-book-of-secret-knowledge

Get curated dev tools and resources for founders and developers, backed by 226k+ GitHub stars.

devtools★ 142,932

Scale web data with firecrawl

Get web data at scale with firecrawl, for founders. 132k+ GitHub stars.

devtools★ 122,939

Free Tools with free-for-dev

Get free SaaS, PaaS, IaaS tiers for devops and infradev with 122k+ GitHub stars, for developers and founders

devtools★ 94,447

Puppeteer: Automate Browsers

Get browser automation with Puppeteer. For founders who need reliable testing and automation tools.

devtools★ 90,352

Playwright: Simplify Web Testing

Get easy cross-browser testing with Playwright, ideal for startup founders and developers, with 90k+ GitHub stars