Giskard

Active
GitHub Python Apache-2.0

Description

AI testing and vulnerability scanning platform covering LLM bias, hallucination, and security.

Key Features

  • Vulnerability scanning — Auto-detect RAG hallucination, prompt injection, toxicity, and bias
  • Multi-model — Integrations for HuggingFace, OpenAI, Anthropic, LangChain
  • Test set management — Centralized test sets and evaluations
  • CI integration — GitHub Actions / GitLab CI in one step
  • Visualization — Detailed HTML reports and team dashboard
  • Customizable — Custom tests for business needs

Use Cases

💡 Auto-test bias and hallucination before LLM rollout.
💡 Block prompt injection risks in CI.
💡 End-to-end quality regression for RAG apps.

Tags

llm-eval vulnerability-scan quality agent-tools

Categories

📊 Observability

Quick Start

# Install
pip install giskard
# Scan an LLM
from giskard import scan
report = scan(my_llm_app)
report.to_html('report.html')
Visit GitHub

Related Projects

Related Articles

RAGhallucination-detectionagent-evaluation

Agent Hallucination Defense: Practical Mitigation Patterns Beyond Guardrails

Why do LLM agents hallucinate? This article traces root causes and systematically reviews practical mitigation patterns: retrieval augmentation, confidence scoring, multi-agent cross-validation, forced citation backtracking, and observability with UpTrain, Giskard, RagaAI Catalyst, Comet Opik, and NVIDIA Garak.

Read more →