Promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
At a glance
Is this tool relevant to you?
What it does
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
May suit
People who want an AI system to plan or carry out multi-step tasks.
Before you try it
The repository reports a MIT license. Setup difficulty and device support still need to be checked upstream.
Evidence & freshness
What we know, and how recently we checked
This record comes from the wider automated directory. It has not yet passed the stronger catalog verification checks.
- Source
- Automated project sync
- Checked
- Evidence level
- Limited confidence
- Maintenance signal
- Strong93/100
Strong automated signals across recent activity, community, and project upkeep.
The health score is an automated maintenance signal, not a security audit or a guarantee that the tool fits your needs.
How verification and health scoring work
⭐
23.5K
Stars
🍴
2.1K
Forks
👥
320
Contributors
💚
Strong93/100
Health Score
Star History
Health Score Breakdown
Star Momentum
100
Commit Frequency
100
Issue Health
80
Contributors
100
Release Cadence
80
Documentation
80
Community Signal
100
Project Info
- Language
- TypeScript
- License
- MIT
- Last Commit
- 2d ago
- Last Release
- 0.121.19 (10d ago)
- Open Issues
- 437
- Bus Factor
- 10
- Commits/Week
- 74.7
- Avg Issue Close
- 4.9 days
cici-cdcicdevaluationevaluation-frameworkllmllm-evalllm-evaluationllm-evaluation-frameworkllmopspentestingprompt-engineeringprompt-testingpromptsragred-teamingtesting
Project Badge
Embed a live health badge in a README or docs page.
[](https://ai-tools-scout.com/projects/promptfoo)Related tools to compare with Promptfoo
Suggested automatically from the same category and shared topics, then ordered by current maintenance and adoption signals.
Weekly AI open-source movers
Get the fastest-growing projects, useful MCP servers, and technical reads in one weekly email.