Promptfoo

CLI for testing and red-teaming LLM applications

Visit Official Site ↗

🤖 Comparing AI agents?

See how this agent ranks in our Best AI Agents guide, or browse the full AI Agents category:

Best AI Agents — ranked guide →All AI Agents →

About Promptfoo

Promptfoo offers a command-line tool for evaluating prompts and red-teaming LLM applications for security and quality. Day to day, configs define test cases and assertions, and CI integration blocks regressions before deployment. It is aimed at builders who need agents that stay observable, controllable and useful once real users and real data are involved every day.

Promptfoo key facts

Category: AI Agents
Pricing: Free — listed in this directory as a free tool, with no paid plan required to use it.
Focus areas: testing, red teaming, cli
Official site: promptfoo.dev

About the AI Agents category

Autonomous AI agents that plan and execute tasks for you — general agents, AI browsers, AI employees, app builders, and coding agents. The AI Agents category on Tools Hub currently lists 156 tools. Alongside Promptfoo, it includes Vellum, Agenta, Weights & Biases, Opik by Comet.

FreeAI Agentstestingred-teamingcli

More in AI Agents

Comparing tools in the AI Agents category? These related listings are worth a look: Vellum — Platform for building and evaluating AI workflows; Agenta — Open-source LLMOps platform for prompt experiments; Weights & Biases — AI developer platform for training and tracking models.