Test AI with promptfoo
Founders get AI vulnerability scanning with promptfoo, used by OpenAI and Anthropic, with 22k+ GitHub stars
21,916 stars1,938 forksTypeScriptQuality 9/10Updated 6/5/2026100% free ยท open source Helps developers systematically test and compare AI prompts, models, and AI systems before putting them into production
- โขWhen building an AI product and want to validate prompt reliability
- โขBefore deploying a RAG (retrieval-augmented generation) system to ensure quality
- โขWhen comparing performance across different AI models and configurations
- 1Install via npm: npm install -g promptfoo
- 2Create a config file defining test cases and models
- 3Run tests with: promptfoo eval
- 4Review performance metrics and comparison report
Ready-to-paste prompt promptfoo eval -c config.yaml
Saves to your device
Topics
ci
ci-cd
cicd
evaluation
evaluation-framework
llm
llm-eval
llm-evaluation
llm-evaluation-framework
llmops
pentesting
prompt-engineering
prompt-testing
prompts
rag
red-teaming
testing
vulnerability-scanners
What's inside โ free to inspect
No purchase needed
Read the entire source before you build โ unlike paid marketplaces that hide it behind a buy button.