Giskard
ActiveDescription
An open-source evaluation and testing library for LLM agents providing automated model scanning, bias detection, performance benchmarking, and compliance checks.
Related Projects
AgentLabs
546 · TypeScript
AgentLabs is a toolkit for agent development and testing, focused on experimentation, replay, and workflow support to improve iteration speed.
testingdeveloper-toolsevaluation +1
Agentic Radar
953 · Python
A security scanner for LLM agentic workflows. Automatically detects security vulnerabilities, prompt injection risks, and permission violations in agent pipelines before deployment.
securityagentpython +2
PrompToMatix
948 · Python
An automatic prompt optimization framework by Salesforce AI Research that leverages LLMs to search for and refine prompts for improved model performance.
prompt-engineeringevaluationllm +1
AgentBench
3.3k · Python
A comprehensive benchmark to evaluate LLMs as agents (ICLR 2024), covering operating systems, databases, knowledge graphs, digital card games and more.
evaluationpythonagent +1