🛡️

Best Security & Guardrails Top 20

Top 20 most popular open-source Security & Guardrails projects, ranked by GitHub Stars.

1

Anthropic Cybersecurity Skills

28.0k Stars

754 structured cybersecurity skills for AI agents mapped to 5 frameworks: MITRE ATT&CK, NIST CSF 2.0, MITRE ATLAS, D3FEND and NIST AI RMF. Works with Claude Code, Codex CLI, Cursor, Gemini CLI and 20+ platforms.

pythonsecurityagenttools
2

Promptfoo

24.3k Stars

Test and evaluate LLM prompts, agents, and RAG pipelines. Built-in red teaming and security evaluation for reliable AI applications.

testingevaluationred-teamingprompt-testing
3

PentAGI

21.9k Stars

Fully autonomous AI Agents system capable of performing complex penetration testing tasks using multi-agent architecture with support for multiple LLM providers.

securitytestingmulti-agentagent
4

SWE-agent

20.1k Stars

SWE-agent takes a GitHub issue and automatically generates fixes using your LLM of choice, also applicable to cybersecurity auditing and competitive coding. NeurIPS 2024 paper.

swecodingagentcybersecurity
5

OpenAI Evals

19.2k Stars

OpenAI's framework for evaluating LLMs and LLM systems, providing an open-source registry of benchmarks and tools for systematic model assessment.

llm-evaluationbenchmarkevalsred-teaming
6

PentestGPT

14.9k Stars

An automated penetration testing agentic framework powered by large language models for security testing and vulnerability discovery.

penetration-testingsecurityllmautomation
7

SkillSpector

14.7k Stars

NVIDIA's SkillSpector inspects and evaluates the tool-use and function-calling skills of LLM agents against safety, correctness, and performance criteria.

security-guardrailsmcpstatic-analysisnvidia
8

OpenSandbox

13.9k Stars

OpenSandbox is an open-source, secure, fast, and extensible sandbox runtime for AI agents, developed by Alibaba.

sandboxai-infrastructurekubernetessecurity
9

E2B

13.4k Stars

E2B provides secure cloud sandboxes for AI agents, supporting code execution, file operations, and isolated compute as an execution layer for coding and automation workflows.

sandboxcode-executionsecuritypython
10

Portkey AI Gateway

12.7k Stars

Portkey AI Gateway is a blazing fast AI gateway with integrated guardrails, routing to 200+ LLMs with 50+ AI guardrails through a single fast and friendly API.

gatewayllm-routingguardrailsai-safety
11

HexStrike AI

11.1k Stars

HexStrike AI is an advanced MCP server that lets AI agents autonomously run 150+ cybersecurity tools for automated pentesting, vulnerability discovery, and security research.

cybersecuritypentestingmcp-serversecurity
12

Presidio

10.5k Stars

Microsoft's open-source context-aware PII detection and de-identification SDK for text, images, and structured data, providing sensitive data protection for LLM applications and agents.

pii-detectiondata-maskingprivacynlp
13

GhidraMCP

9.8k Stars

MCP server for Ghidra reverse engineering platform, enabling AI agents to autonomously perform binary analysis and vulnerability discovery.

mcpreverse-engineeringghidrasecurity
14

CAI

9.7k Stars

Alias Robotics' open-source AI security research agent framework for multi-agent orchestration of cybersecurity tasks, integrating 300+ AI models, designed for red-team operations and security research.

cybersecurityai-agentsred-teampentest
15

Garak

8.8k Stars

NVIDIA's open-source LLM vulnerability scanner that automatically detects security issues in language models including safety vulnerabilities, hallucination tendencies, jailbreak risks, and prompt injection attacks.

llm-securityvulnerability-scannerllm-evaluationred-teaming
16

OpenShell

8.2k Stars

OpenShell is the safe, private runtime for autonomous AI agents, developed by NVIDIA. Provides controlled execution environments and resource management.

rustagentframeworksecurity
17

Microsandbox

7.6k Stars

Secure, local, cross-platform and programmable sandboxes for AI agents. Provides strict resource isolation using microVM technology.

rustagenttoolssecurity
18

Guardrails AI

7.3k Stars

Guardrails AI adds programmable guardrails to large language models, ensuring reliability and safety through input/output validation, structured data extraction, and custom validators.

guardrailsllm-safetyvalidationoutput-validation
19

NeMo Guardrails

7.0k Stars

NVIDIA NeMo Guardrails is an open-source toolkit for adding programmable guardrails to LLM-based conversational systems, supporting topic control, safety enforcement, and dialog guidance.

guardrailsllm-safetynvidiaconversational-ai
20

Superagent

6.7k Stars

Superagent protects AI applications against prompt injections, data leaks, and harmful outputs, embedding safety directly into your app.

ai-safetyguardrailsagent-toolssecurity

Related Articles