Promptfoo

Active

GitHub TypeScript MIT

Description

CLI tool that combines LLM prompt testing with red-teaming.

Key Features

Prompt testing — Batch prompt evaluation
Red team — 50+ attack strategies
CI integration — GitHub Actions
Multi-model — Single yaml, many providers
Visualization — Web UI

Use Cases

💡 Run prompt AB tests for LLM apps.

💡 Run red team cases in CI.

💡 Compare outputs across models.

Quick Start

# Install and run
npm install -g promptfoo
promptfoo eval -c promptfooconfig.yaml

Visit GitHub

Related Projects

Giskard

5.4k · Python

Active

An open-source evaluation and testing library for LLM agents providing automated model scanning, bias detection, performance benchmarking, and compliance checks.

evaluationtestingllm-safety +3

DeepTeam

1.9k · Python

Active

Automated LLM red-teaming framework by the DeepEval team.

red-teamsecuritydeepteam +1

Promptfoo

22.5k · TypeScript

Active

Test and evaluate LLM prompts, agents, and RAG pipelines. Built-in red teaming and security evaluation for reliable AI applications.

testingevaluationred-teaming +2

LLM Guard

3.1k · Python

Stale

The security toolkit for LLM interactions, providing prompt injection detection, PII anonymization, content safety auditing, and more to secure production LLM deployments.

securityllmpython +2

security-guardrailsred-teamprompt-injection

AI Agent Guardrails and Red Teaming in Practice: From Rule Engines to Adversarial Evaluation

Five-layer defense plus red-team loop, built on five open-source projects you can copy.

Promptfoo

Description

Key Features

Use Cases

Tags

Categories

Quick Start

Related Projects

Giskard

DeepTeam

Promptfoo

LLM Guard

Related Articles

AI Agent Guardrails and Red Teaming in Practice: From Rule Engines to Adversarial Evaluation