View Issue Details

IDProjectCategoryView StatusLast Update
0009598Kali LinuxNew Tool Requestspublic2026-03-24 13:27
Reportera1baradi Assigned To 
PrioritynormalSeverityminorReproducibilityhave not tried
Status newResolutionopen 
Summary0009598: xurl — Silent URL Deduplication tool for Security Researchers
Description

Tool Name: xurl

Author : Al Baradi Joy

It's Build for Remove duplicate path and format from urls.

For Example :

Security Researcher/BugBounty Hunter or pentester Usually Crawl website for Understand mapping of website and test for vulnerability like xss,sqli,lfi and others

On those time,Security Researcher face urls like :

example.com/profile?id=1
example.com/profile?id=2
example.com/profile?id=2
example.com/about
example.com/about/
example.com/about/admin

Using that tool Researcher Only got :

example.com/profile?id=1
example.com/about
example.com/about/admin

During automation on XSS and others,Researcher usually Need to Remove all those type of Duplicate.

It's Reduce urls and Researcher Can Test Unique path,format type of urls.That's make automation faster

Similar Type of Tools :

https://github.com/ameenmaali/urldedupe

https://github.com/s0md3v/uro

Bug hunters already use those tools, but there are no official tools on Kali Linux like them. My tool has better features than both of those tools.

Tool : https://gitlab.com/a1baradi/xurl

Installation :

git clone https://gitlab.com/a1baradi/xurl
cd xurl
chmod +x xurl.py
sudo mv xurl.py /usr/bin/xurl

Attached Files

Activities

a1baradi

a1baradi

2026-03-24 13:10

reporter   ~0021449

Last edited: 2026-03-24 13:27

Basic Usage :

cat urls.txt | xurl
cat urls.txt | xurl | tee -a unique.txt
xurl -i urls.txt -o clean.txt

Pipeline examples :

waybackurls target.com | xurl

subfinder -d target.com | httpx -silent | katana | xurl | tee urls.txt

Using filter for Only URLs with query parameters :

cat urls.txt | xurl -f hasparams | tee params.txt

More Filter also Exist.Check on : https://gitlab.com/a1baradi/xurl

On Filter Section from Readme

Issue History

Date Modified Username Field Change
2026-03-24 13:02 a1baradi New Issue
2026-03-24 13:02 a1baradi File Added: Screenshot 2026-03-24 09:01:20.png
2026-03-24 13:10 a1baradi Note Added: 0021449
2026-03-24 13:27 a1baradi Note Edited: 0021449