View Issue Details
ID | Project | Category | View Status | Date Submitted | Last Update |
---|---|---|---|---|---|
0007320 | Kali Linux | New Tool Requests | public | 2021-09-06 14:22 | 2021-09-19 11:19 |
Reporter | moulik | Assigned To | |||
Priority | normal | Severity | minor | Reproducibility | N/A |
Status | closed | Resolution | no change required | ||
Product Version | 2021.2 | ||||
Summary | 0007320: webcheck scans for the target URL and tells the error ones and also tell the valid URL's | ||||
Description | [Description]: But sometimes these paths typed in the Disallows entries are directly accessible by the users without using a search engine, just visiting the URL and the Path, and sometimes they are not available to be visited by anybody. Because it is really common that the administrators write a lot of Disallows and some of them are available and some of them are not, you can use webcheck in order to check the HTTP status code of each Disallow entry in order to check automatically if these directories are available or not. Also, the fact the administrator write a robots.txt doesn't mean that the files or directories typed in the Disallow entries will not be indexed by Bing, Google, Yahoo, etc. For this reason, webcheck is capable of searching in Bing to locate content indexed without the web administrator authorization. webcheck will check the HTTP status code in the same way for each Bing result. When you execute webcheck, you can see the HTTP status codes. For example, the codes below: content.200 OK The request has succeeded. webcheck homepage | webcheck repo [Dependencies]: The tool needs python version 3 and above to work [Similar tools]: Parsero is a very similar tool but it's very old and this is the upgraded version of parsero with new features [Packaged]: This tool is not pre available in the Debian package | ||||
Steps To Reproduce | [Installing]: open terminal [Usage]: usage: webcheck.py [-h] [-u URL] [-o] [-sb] optional arguments: [Example]: root@kali:~# python3 webcheck.py -u www.example.com -sb
$$\ $$\ $$\ $$$$$$\ $$$$$$$\ $$$$$$$\ $$$$$$$\ $$$$$$\ $$$$$$$\ $$ | $$\ $$\ $$\ $$\ $$\ Starting webcheck v0.75 (https://github.com/moulik-source/webcheck) at 05/22/14 11:12:55 [+] 9 links have been analyzed and 3 of them are available!!! Searching the Disallows entries in Bing http://www.bing.com/search?q=site:http://example.com/download.php
Finished in 7.290362596511841 seconds | ||||
Additional Information | [Doing all scan]:
$$\ $$\ $$\ $$$$$$\ $$$$$$$\ $$$$$$$\ $$$$$$$\ $$$$$$\ $$$$$$$\ $$ | $$\ $$\ $$\ $$\ $$\ Starting webcheck v0.75 (https://github.com/moulik-source/webcheck) at 05/22/14 11:12:55 [+] 9 links have been analyzed and 3 of them are available!!! Searching the Disallows entries in Bing http://www.bing.com/search?q=site:http://example.com/download.php
Finished in 7.290362596511841 seconds | ||||
Attached Files | |||||
Date Modified | Username | Field | Change |
---|---|---|---|
2021-09-06 14:22 | moulik | New Issue | |
2021-09-06 14:22 | moulik | File Added: 2021-09-06 18_23_19-Kali - VMware Workstation 16 Player (Non-commercial use only).png | |
2021-09-06 14:28 | moulik | Note Added: 0015083 | |
2021-09-19 11:19 | g0tmi1k | Note Added: 0015214 | |
2021-09-19 11:19 | g0tmi1k | Status | new => closed |
2021-09-19 11:19 | g0tmi1k | Resolution | open => no change required |