Garak (NVIDIA)
VerifiedOpen-source LLM vulnerability scanner by NVIDIA. Probes LLMs for known vulnerabilities including prompt injection, jailbreaks, data leakage, and hallucination.
Frameworks Covered
NIST-AI-RMFEU-AI-Act
Services
llm-red-teamingvulnerability-scanningprompt-injection-testingsecurity-audit
About Garak
Garak (Guidance and Reliability Assessment Kit) is an open-source LLM vulnerability scanner originally developed by Leon Derczynski at NVIDIA. It probes LLMs for known vulnerabilities — prompt injection, jailbreaks, data leakage, hallucination, misinformation, and more — using a comprehensive suite of probes.
Features
- 100+ vulnerability probes across multiple categories
- Prompt injection and jailbreak testing
- Data leakage and PII extraction testing
- Hallucination and misinformation detection
- Supports OpenAI, HuggingFace, local models, and custom endpoints
- JSON and HTML report generation
- CI/CD integration for automated security testing
- Extensible probe system
Installation
pip install garak
Loading reviews...