View Issue Details

IDProjectCategoryView StatusLast Update
0009586Kali LinuxNew Tool Requestspublic2026-03-16 16:46
ReporterRichardBarron27 Assigned Todaniruiz  
PrioritynormalSeverityminorReproducibilityhave not tried
Status closedResolutionno change required 
Summary0009586: Red-Specter-Forge - Automated LLM Security Testing Framework
Description

Name] Red Specter Forge
[Version] 1.0.0
[Homepage] https://red-specter.co.uk/forge/
[Download] https://red-specter.co.uk/forge/docs/
[Author] Richard Barron / Red Specter Security Research
[Licence] Apache 2.0
[Description] Red Specter Forge is an automated LLM security testing framework. It provides 10 tools to test language models before agent development, covering prompt injection, jailbreaks, output compliance, policy adherence, drift, and supply chain validation. It features 1,590 static payloads, a 25-variant mutation engine, and statistical rigour (Wilson CIs, KS tests). It generates Ed25519-signed reports mapped to OWASP LLM Top 10 2025.
[Dependencies] None (pure Python)
[Similar tools] Unlike Garak, PyRIT, or Promptfoo, Forge offers adaptive escalation, mutation engines, statistical rigour, and direct integration with runtime protection (AI Shield). No existing Kali tool provides this level of comprehensive, automated LLM security testing.
[Activity] Active development. v1.0.0 released March 2026. 9,057 tests passing, zero failures.
[How to install] pip install red-specter-forge
[How to use] forge full-scan --target https://api.openai.com --model gpt-4
[Packaged] Yes — Debian package (.deb) available.

Activities

Arszilla

Arszilla

2026-03-13 15:00

reporter   ~0021428

No source code repository. Unless there's one, this will not be packaged by the team or any contributor.

RichardBarron27

RichardBarron27

2026-03-14 08:57

reporter   ~0021435

Hi Arszilla,

Thank you for the honest feedback and for taking the time to review the submission. I understand and respect Kali's packaging policies and the need for fully open, publicly accessible source code.

For now, we'll be focusing our immediate efforts on other distribution channels that align with our current development and release model. Should our approach to public source availability change in the future, I'll certainly revisit the possibility of submitting to Kali again.

Appreciate your time and consideration.

arnaudr

arnaudr

2026-03-16 16:46

manager   ~0021436

Hello @RichardBarron27,

thank you for your submission, but we'll have to decline.

Broadly speaking, we don't and we can't package every possible infosec tools in Kali. So we prioritize tools that already have a notoriety of some sort, a proven userbase, some kind of maturity, etc. It also helps if the software is developed in the open, so that we can assess what the tool is, what it does, and see what the wider infosec community thinks of it.

Best of luck with your project!

Issue History

Date Modified Username Field Change
2026-03-11 09:56 RichardBarron27 New Issue
2026-03-12 07:19 daniruiz Summary Red Specter Forge - Automated LLM Security Testing Framework => Red-Specter-Forge - Automated LLM Security Testing Framework
2026-03-13 15:00 Arszilla Note Added: 0021428
2026-03-14 08:57 RichardBarron27 Note Added: 0021435
2026-03-16 09:39 daniruiz Assigned To => daniruiz
2026-03-16 09:39 daniruiz Status new => closed
2026-03-16 09:39 daniruiz Resolution open => no change required
2026-03-16 16:46 arnaudr Note Added: 0021436