View Issue Details

Jump to NotesJump to History
IDProjectCategoryView StatusDate SubmittedLast Update
0008956Kali LinuxQueued Tool Additionpublic2024-10-14 14:172025-10-03 14:57
Reporterjtlucas Assigned To 
PrioritynormalSeverityminorReproducibilityhave not tried
Status acknowledgedResolutionopen 
Summary0008956: Garak - LLM Vulnerability Scanner
Description

Name: Garak
Version: v0.9.0.16
Homepage: https://garak.ai/
Download: https://pypi.org/project/garak/#files
Author: Leon Derczynski (NVIDIA)
License: Apache License 2.0
Description: Garak is an LLM vulnerability scanner that probes for hallucination, data leakage, prompt injection, misinformation, toxicity generation, jailbreaks, and many other weaknesses.
Dependencies: Python3.10+, other python dependencies
Similar Tools:
Activity: Leon started the project as an academic researcher, but it has since been adopted as the tool-of-choice at NVIDIA with active in-house and open source development.
How to install: It is pip-installable
How to use: garak --model_type huggingface --model_name gpt2 --probes lmrc.Profanity would scan the gpt2 model from huggingface with the profanity probe
Packaged: No, but if this gets a green-light, we can take care of that.

Activities

jtlucas

jtlucas

2024-10-14 15:31

reporter   ~0019909

I'm happy to answer any questions about how we use this on the AI Red Team at NVIDIA or links to the DEFCON talk, video, or ARXIV paper.
g0tmi1k

g0tmi1k

2025-10-03 14:57

administrator   ~0020856

@kali-team, please could this be packaged up.
@author, If you want to help the packaging process, you can check the documentation here:

Issue History

Date Modified Username Field Change
2024-10-14 14:17 jtlucas New Issue
2024-10-14 15:31 jtlucas Note Added: 0019909
2025-10-03 14:57 g0tmi1k Note Added: 0020856
2025-10-03 14:57 g0tmi1k Status new => acknowledged
2025-10-03 14:57 g0tmi1k Category New Tool Requests => Queued Tool Addition