Garak
ActiveDescription
NVIDIA's open-source LLM vulnerability scanner that automatically detects security issues in language models including safety vulnerabilities, hallucination tendencies, jailbreak risks, and prompt injection attacks.
Related Projects
AI-Infra-Guard
3.5k · Python
Tencent's full-stack AI red teaming platform integrating OpenClaw security scanning, agent scanning, skills scanning, MCP scanning, AI infrastructure scanning, and LLM jailbreak evaluation.
ai-securityred-teamingllm-security +2
Agentic Security
1.8k · Python
An open-source LLM vulnerability scanner and AI red teaming kit for automated security fuzzing of LLM applications, detecting jailbreaks, prompt injection, and adversarial attacks.
llm-securityred-teamingllm-fuzzer +2
OpenAI Evals
18.2k · Python
OpenAI's framework for evaluating LLMs and LLM systems, providing an open-source registry of benchmarks and tools for systematic model assessment.
llm-evaluationbenchmarkevals +2
LM Evaluation Harness
12.2k · Python
A framework for few-shot evaluation of language models by EleutherAI, providing standardized evaluation pipelines supporting hundreds of benchmark tasks and widely adopted as a core LLM evaluation tool in the community.
llm-evaluationbenchmarkevaluation-framework +2