View Issue Details

IDProjectCategoryView StatusLast Update
0009663Kali LinuxNew Tool Requestspublic2026-05-04 13:40
Reporterxm4skbyt3z Assigned Todaniruiz  
PrioritynormalSeverityminorReproducibilityhave not tried
Status closedResolutionwon't fix 
Summary0009663: Promptix - LLM security scanner (prompt injection / jailbreak / leakage)
Description

[Name]
Promptix

[Version]
0.1.0 (git tag v0.1.0)

[Homepage]
https://github.com/xm4skbyt3z/promptix

[Download]
https://github.com/xm4skbyt3z/promptix/archive/refs/tags/v0.1.0.tar.gz

[Author]
Deivid Kelven (xM4skByt3z)

[Licence]
MIT

[Description]
Promptix is a CLI tool I wrote to pentest LLM endpoints. It scans for the issues
listed in the OWASP Top 10 for LLM Applications: prompt injection, jailbreaks
(DAN, dev-mode, roleplay, encoding bypass), system-prompt and credential
leakage, sycophancy/bias, and adversarial robustness (Unicode confusables,
zero-width chars, char swaps, plus optional decision-boundary estimation via
ART).

The UX is meant to feel familiar to anyone who already uses sqlmap or nmap:
flat flags, one command, and you get either stdout output, a JSON report, or a
full Markdown pentest report.

It works against any OpenAI-compatible API (OpenAI, Ollama, vLLM, LM Studio,
llama.cpp), generic HTTP endpoints with a configurable body template, and ships
an offline echo stub so you can demo it or wire it into CI without an API key.

I have been testing it locally against Ollama (llama3.2:1b) on Kali and it
catches real prompt-injection bypasses on the small models, which is what I
wanted from it.

[Dependencies]

  • python3 (>= 3.10)
  • python3-httpx (>= 0.27)
  • python3-rich (>= 13.7)
  • python3-typer (>= 0.12)
  • python3-prompt-toolkit (>= 3.0)
  • python3-yaml (>= 6.0)
  • python3-pydantic (>= 2.6)

Optional, only needed for the ART boundary-estimation feature in the
robustness module:

  • python3-numpy (>= 1.26)
  • python3-sklearn (>= 1.4)
  • adversarial-robustness-toolbox (>= 1.17)

[Similar tools]
There are a few tools in this space, but none of them really fit the
pentester workflow:

  • garak: big plugin-based scanner, more of a research framework, no
    single-command CLI and a lot heavier to set up.
  • PyRIT (Microsoft): Python API only, no CLI, mostly oriented at Azure AI
    red-teaming.
  • PromptBench: academic adversarial benchmark, not a pentest tool.
  • promptmap: only does prompt injection, single module.

Promptix covers the five OWASP LLM categories in one command and uses the
same flag style as sqlmap, which is the gap I wanted to fill.

[Activity]
Started the project in May 2026, actively developing it. 0.1.0 is the first
public release: https://github.com/xm4skbyt3z/promptix/releases/tag/v0.1.0

[How to install]
From the tagged release:

wget https://github.com/xm4skbyt3z/promptix/archive/refs/tags/v0.1.0.tar.gz
tar xzf v0.1.0.tar.gz
cd promptix-0.1.0
pip install .

Or with the install script in the repo (works on Kali / Debian):

git clone https://github.com/xm4skbyt3z/promptix
cd promptix
git checkout v0.1.0
sudo bash install.sh

[How to use]

Offline demo, no API key or internet needed

promptix --echo

Scan a local Ollama instance

promptix -u http://localhost:11434/v1

Scan OpenAI with a specific model

promptix -u https://api.openai.com/v1 --key $OPENAI_API_KEY --model gpt-4o

Run only the jailbreak and leakage modules and save reports

promptix -u http://target/v1 -m jailbreak -m leakage -o report.json --report-md report.md

Quick scan: 5 payloads, 8 concurrent, 10s timeout

promptix --echo --max-payloads 5 -c 8 -T 10

[Packaged]
Yes, the repo already has a debian/ directory with everything needed for a
Kali package:

  • debian/control
  • debian/changelog
  • debian/rules (dh-python / pybuild)
  • debian/copyright (DEP-5)
  • debian/source/format (3.0 quilt)
  • debian/promptix.manpages (installs docs/promptix.1)

Happy to adjust anything if it helps with packaging. Thanks!

Activities

daniruiz

daniruiz

2026-05-04 13:40

manager   ~0021642

Hello,

Thanks for your submission. We can’t package every infosec tool, so we prioritize those with wider adoption and community usage.

Best of luck with your project.

Issue History

Date Modified Username Field Change
2026-05-03 03:30 xm4skbyt3z New Issue
2026-05-04 13:40 daniruiz Assigned To => daniruiz
2026-05-04 13:40 daniruiz Status new => closed
2026-05-04 13:40 daniruiz Resolution open => won't fix
2026-05-04 13:40 daniruiz Note Added: 0021642