NeMo Guardrails
ActiveDescription
NVIDIA NeMo Guardrails is an open-source toolkit for adding programmable guardrails to LLM-based conversational systems, supporting topic control, safety enforcement, and dialog guidance.
Key Features
- Programmable guardrails for LLM-based conversational apps
- Input, dialog, and output rails for comprehensive control
- Protection against jailbreaks and prompt injections
- Support for multiple LLMs including GPT-4, LLaMa-2, Falcon
- Colang programming language for defining rail flows
- Async-first design with sync and async APIs
Use Cases
💡 RAG applications requiring fact-checking and moderation
💡 Domain-specific chatbots staying on designated topics
💡 Safe LLM endpoints for customer-facing applications
💡 LangChain chains with added safety layer
💡 Enterprise AI assistants with compliance requirements
Categories
Quick Start
Install with pip install nemoguardrails. Load a guardrails configuration and create an LLMRails instance. Use rails.generate() to make guarded LLM calls. Supports Python 3.10-3.13 and multiple LLM providers.