workflowstacks
devtools

Test AI with promptfoo

Founders get AI vulnerability scanning with promptfoo, used by OpenAI and Anthropic
intermediate⏱ 30 minutesπŸ’΅ Free (self-hosted)
25,117 stars2,308 forksTypeScriptGuide quality 9/10 Β· reviewed Jun 5Updated 9/15/2026100% free Β· open source
What it is

Scan AI systems for security vulnerabilities

Real use case example

"A founder, Alex, wants to validate the security of their AI-powered customer service chatbot. Alex imports their chatbot model into promptfoo, creates a simple configuration, and runs a vulnerability scan. The result is a detailed report highlighting potential security issues for Alex to address."

When to use it
  • β€’When building an AI product and want to validate prompt reliability
  • β€’Before deploying a RAG (retrieval-augmented generation) system to ensure quality
  • β€’When comparing performance across different AI models and configurations
Ready-to-paste prompt
promptfoo eval -c config.yaml
Saves to your device
Use with Claude
New

Skip the builder β€” one click puts this in Claude, Cursor, Antigravity and more.

⚑ Runs out of the box

A prompt/skill package β€” nothing to install beyond adding it to your AI tool.

Try it instantly β€” no install
Claude Code
mkdir -p ~/.claude/skills/promptfoo && curl -fsSL https://workflowstacks.com/api/skills/promptfoo/claude-skill -o ~/.claude/skills/promptfoo/SKILL.md
Open in another AI app

Opens the app with this repo with the prompt ready to go β€” no copy-paste needed.

Connect the whole catalog (MCP)
claude mcp add --transport http workflowstacks https://workflowstacks.com/api/mcp

Adds a WorkflowStacks connector to Claude Code: search and load any skill here by chatting.

How Test AI with promptfoo works
Codeflow
Free to inspect

Test AI with promptfoo is a very large TypeScript project (~469k lines across 2019 code files, plus 968 test files). You install it into your AI tool with one command; there is nothing to run yourself. Last commit this month, MIT license, has a test suite.

Size
Very large codebase
~469k lines Β· 2019 code files Β· days to read β€” use, don't read
Setup
Install as a skill / plugin
Add it to Claude Code (or your AI tool) with one command β€” 17 skills inside. Nothing to run yourself.
Runs on
Inside your AI tool
Helper scripts use Node.js Β· Docker
TypeScript 97%CSS 2%JavaScript 1%
Where to start reading
  1. 1
    README.md
    Start here β€” what it does and how to install it
  2. 2
    AGENTS.md
    The instructions the AI actually follows
  3. 3
    src/main.ts
    Where the program starts running
  4. 4
    src/index.ts
    Inside src/ β€” the main logic begins here
  5. 5
    examples/AGENTS.md
    A worked example β€” copy this to get going
What's in each folder
src/Core code β€” the actual logic1691 files
site/Frontend / UI1279 files
plugins/Sub-packages / plugins18 files
examples/Examples you can copy1245 files
docs/Documentation15 files
drizzle/Folder52 files
scripts/Helper scripts17 files
code-scan-action/Folder13 files
READMEHas testsDocumentedCI checksDocker readyExamples includedMIT licenseUpdated this month
Quick Actions
Details
Creator
promptfoo
Language
TypeScript
Category
devtools
Published
4/28/2023

Are you the creator of this tool? Claim your listing β†’ and earn 85% of every sale.

Show it off in your README:

Featured on WorkflowStacks
[![Featured on WorkflowStacks](https://workflowstacks.com/api/badge/promptfoo.svg)](https://workflowstacks.com/skills/promptfoo?utm_source=github&utm_medium=badge)
πŸ”₯ Hot this week, in your inbox
Skills like this, every Monday.

The five fastest-growing open-source AI skills, ranked by GitHub star growth. One email a week, unsubscribe anytime.

Do this with a working workflow

Pages we wrote and tested that put a skill like this to work β€” importable n8n templates, outcome guides and Claude Desktop configs.

Free n8n template

Weekly Client Report

Every Monday, turn the week’s metrics into a clear client-facing narrative report β€” what happened, why, what’s next β€” and email it automatically.

Outcome guide

Automate your weekly client reports

Keep each client’s metrics in a Google Sheet. Every Monday the workflow reads the week’s numbers, writes a plain-English narrative β€” what moved, why, and what’s next β€” and emails it to the client.

MCP config

GitHub MCP config

Search repos, read code, open issues and PRs from Claude.

Related skills

More devtools tools founders pair with this one.

devtoolsβ˜… 179,367
Scale web data with firecrawl
Get web data at scale with firecrawl.
devtoolsβ˜… 112,319
browser-use: Automate Web Tasks
Founders use browser-use to automate online tasks with ease, ideal for startups needing AI-powered browser automation.
devtoolsβ˜… 95,478
Puppeteer: Automate Browsers
Get browser automation with Puppeteer.
devtoolsβ˜… 17,435
Maxun: API-ify websites fast
Turn websites into APIs in minutes with maxun, a no-code platform for founders and developers.
devtoolsβ˜… 125
Noip-renewer: Automated Host Renewal
Automate No-IP host renewal with noip-renewer.
devtoolsβ˜… 2,018
invisible_playwright: Undetected Automate
Get stealthy browser automation with invisible_playwright, for startup founders