Promptfoo

Test, evaluate, and red-team LLM apps from the command line or CI.

Promptfoo is an open-source CLI and library for evaluating and red-teaming LLM applications. It runs declarative test matrices across prompts, models, and providers, scores results with assertions and graders, and produces side-by-side comparison views. It also includes automated vulnerability scanning for prompt injection, jailbreaks, and other LLM security risks, and integrates cleanly into CI.