View Issue Details

IDProjectCategoryView StatusLast Update
0009848Kali LinuxNew Tool Requestspublic2026-09-23 13:06
Reporteraleffisnotavailable Assigned To 
PrioritynormalSeverityminorReproducibilityhave not tried
Status newResolutionopen 
Summary0009848: wayparam - Passive Wayback URL and parameter discovery for recon workflows
Description

[Name]

wayparam

[Version]

0.4.0

Git tag: v0.4.0

[Homepage]

https://aleff-github.github.io/wayparam/

Source repository:
https://github.com/aleff-github/wayparam

[Download]

Tagged release:
https://github.com/aleff-github/wayparam/releases/tag/v0.4.0

Source archive:
https://github.com/aleff-github/wayparam/archive/refs/tags/v0.4.0.tar.gz

Pre-built Debian packages are also attached to the GitHub release.

[Author]

Aleff

[Licence]

GNU General Public License v3.0 (GPL-3.0)

[Description]

wayparam is a passive OSINT and reconnaissance tool for discovering historical parameterized URLs through the Internet Archive Wayback CDX API.

It does not crawl or actively scan the target. Instead, it queries archived public data, removes static/noisy URLs and canonicalizes the resulting URLs so that query parameter values can be replaced with a configurable placeholder (FUZZ by default).

The resulting output is designed to be directly usable in penetration-testing and bug-bounty reconnaissance pipelines.

Main features include:

  • Passive URL discovery through the Wayback CDX API
  • Single-domain and multi-domain input
  • Optional subdomain discovery
  • Query parameter normalization using a configurable placeholder
  • URL canonicalization and deduplication
  • Static asset filtering using extension blacklists/whitelists
  • Optional path-regex filtering
  • Tracking-parameter removal
  • Date-range and CDX filtering
  • Asynchronous multi-domain processing
  • Configurable concurrency and rate limiting
  • Retry/backoff handling
  • Proxy support
  • Plain-text and JSONL output
  • Clean stdout/stderr separation for Unix pipelines
  • Per-domain output files or direct stdout streaming
  • A lossless CDX block-pagination mode to avoid losing entries at pagination boundaries when collapse is enabled
  • Man page and Debian packaging

An optional local web interface exists as a separate package, but the wayparam CLI has no dependency on it.

[Why it would be useful in Kali]

wayparam is intended specifically for the reconnaissance phase of authorized penetration tests, security research and bug-bounty workflows.

A common workflow is to retrieve historical URLs, identify endpoints containing query parameters and feed those endpoints into additional security-testing tools.

wayparam produces normalized, deterministic and machine-readable output specifically for this use case.

For example:

wayparam -d example.com --stdout --no-files

produces normalized parameterized URLs directly on stdout, allowing them to be piped into other security tooling.

The tool is passive with regard to the assessed target because the requests are sent to the Internet Archive rather than the target itself.

[Dependencies]

Runtime:

  • Python >= 3.9
  • python3-httpx >= 0.26.0

Debian build dependencies:

  • debhelper-compat (= 13)
  • dh-python
  • python3-all
  • python3-setuptools
  • pybuild-plugin-pyproject
  • python3-httpx >= 0.26.0

The project is architecture-independent.

[Similar tools]

Some related tools already available in Kali include:

  • ParamSpider
  • getallurls (gau)
  • waybackpy

There is intentional overlap in the general area of historical URL discovery, but wayparam focuses specifically on producing normalized parameterized endpoints for security-testing pipelines.

Compared with general URL collectors such as gau, wayparam focuses on Wayback CDX retrieval, URL filtering, deterministic canonicalization and query-parameter normalization.

Compared with ParamSpider, wayparam is a complete rewrite with asynchronous I/O, configurable rate limiting/concurrency, JSONL output, clean stdout/stderr separation, proxy support, CDX filtering/date ranges, multi-domain operation and more robust CDX pagination.

Compared with waybackpy, which is a general-purpose Python interface to several Wayback Machine APIs, wayparam is designed around security reconnaissance and parameterized-endpoint discovery.

[Activity]

The project is actively maintained.

The current stable release is v0.4.0.

The repository contains automated tests, release automation, Debian packaging, a man page and documentation.

Recent releases:

  • v0.4.0
  • v0.3.1
  • v0.3.0

[How to install]

A Debian package for the tagged v0.4.0 release is available:

wget https://github.com/aleff-github/wayparam/releases/download/v0.4.0/wayparam_0.4.0-1_all.deb

sudo apt install ./wayparam_0.4.0-1_all.deb

The tagged source release contains a debian/ directory and can also be built as a Debian package using the standard Debian packaging toolchain.

The Python package can alternatively be installed from the tagged release with pip/pipx.

[How to use]

Basic passive discovery for one domain:

wayparam -d example.com

Stream normalized URLs directly to stdout:

wayparam -d example.com --stdout --no-files

Include subdomains:

wayparam -d example.com --include-subdomains

Produce JSONL output:

wayparam -d example.com --stdout --no-files --format jsonl

Limit the request rate and concurrency:

wayparam -d example.com --rps 1 --concurrency 2

Use a proxy:

wayparam -d example.com --proxy http://127.0.0.1:8080

Query multiple domains:

wayparam -l domains.txt

[Packaged]

Yes, Debian packaging is included upstream in the debian/ directory.

The source package currently produces two binary packages:

  • wayparam — the CLI and man page
  • wayparam-gui — optional local web interface

Pre-built .deb packages are automatically attached to tagged GitHub releases.

wayparam is not currently part of the official Debian archive.

Activities

aleffisnotavailable

aleffisnotavailable

2026-09-21 15:58

reporter   ~0022014

Update: wayparam has progressed significantly since this request was originally submitted and the current stable release is now v1.0.0.

Release:
https://github.com/aleff-github/wayparam/releases/tag/v1.0.0

Source archive:
https://github.com/aleff-github/wayparam/archive/refs/tags/v1.0.0.tar.gz

Upstream repository:
https://github.com/aleff-github/wayparam

Homepage:
https://aleff-github.github.io/wayparam/

The project remains actively maintained and Debian packaging is still maintained directly upstream in the debian/ directory.

Pre-built architecture-independent Debian packages are automatically produced for tagged releases. For v1.0.0:

https://github.com/aleff-github/wayparam/releases/download/v1.0.0/wayparam_1.0.0-1_all.deb

Since the original v0.4.0 submission, wayparam has evolved beyond basic Wayback parameter discovery.

The current release includes, among other improvements:

  • Wayback CDX and Common Crawl archive providers
  • Multi-source archive collection
  • Source provenance preservation
  • Archive coverage comparison
  • Historical endpoint intelligence
  • Parameter-history analysis
  • First/last-seen information and capture counts
  • HTTP status and MIME distributions
  • Parameter prevalence analysis
  • Year/month temporal analysis
  • Temporal change analysis
  • Surface topology analysis
  • Host/path grouping
  • Parameter-set variants
  • Parameter co-occurrence analysis
  • Versioned evidence-report bundles
  • JSONL output suitable for security automation pipelines
  • Asynchronous processing, rate limiting and retry/backoff
  • Deterministic URL canonicalization and parameter normalization
  • Separate optional local web interface

The core CLI remains passive with regard to the assessed target: archive data is queried from public archive indexes rather than by crawling or actively scanning the target.

Basic usage remains simple:

wayparam -d example.com

Pipeline usage:

wayparam -d example.com --stdout --no-files

Wayback + Common Crawl:

wayparam -d example.com --source wayback,commoncrawl

Historical endpoint intelligence:

wayparam -d example.com --history --stdout --no-files --format jsonl

The project is also distributed through PyPI and BlackArch, and tagged GitHub releases provide Debian packages.

The runtime dependency remains intentionally small:

  • Python >= 3.9
  • python3-httpx >= 0.26.0

The project is licensed under GPL-3.0.

I am available to make any packaging changes required for inclusion in Kali or to provide additional testing/information if useful.

Thank you for considering wayparam for Kali Linux.

Issue History

Date Modified Username Field Change
2026-09-03 13:49 aleffisnotavailable New Issue
2026-09-21 15:58 aleffisnotavailable Note Added: 0022014