View Issue Details

IDProjectCategoryView StatusLast Update
0007649Kali LinuxQueued Tool Additionpublic2024-04-19 09:19
Reporterakamhy Assigned Todaniruiz  
PrioritynormalSeverityminorReproducibilityN/A
Status resolvedResolutionfixed 
Fixed in Version2024.2 
Summary0007649: waybackpy - CLI tool that interfaces the Wayback Machine API
Description

[Name] - waybackpy
[Version] - 3.0.6
[Homepage] - https://github.com/akamhy/waybackpy
[Download] - https://pypi.org/project/waybackpy/#files
[Author] - akamhy
[Licence] - MIT License
[Description] - Waybackpy is a CLI tool that interfaces with the Wayback Machine APIs. It can be used to access the SavePageNow API, CDX Server API, and also the Availability API of Wayback Machine.
[Dependencies] - Python3.6+, urllib3, click, requests

[Similar tools]
https://asciinema.org/a/469890
getallurls - https://github.com/lc/gau (gau uses CDX API for fetching archives but also has fewer filtering capabilities compared to waybackpy, but gau also uses other sources)

savepagenow - https://github.com/palewire/savepagenow (savepagenow can only save URLs, does not fetch saved URLs.)

Both of these tools overlap in functionality to waybackpy in some minor ways but are no direct alternatives.

[Activity] - The project was started on May 2, 2020. Yes, it is still actively maintained and the latest version was released on Mar 15, 2022
[How to install] - pip install waybackpy==3.0.6

[How to use] -

Saving a URL

waybackpy --url "https://en.wikipedia.org/wiki/Social_media" --user_agent "my-unique-user-agent" --save

Retrieving archive close to a specific date and time

waybackpy --url google.com --user_agent "my-unique-user-agent" --near --year 2008 --month 8 --day 8 --hour 8

Known URLs for a website/host

waybackpy --url kali.org --user_agent "my-user-agent" --known_urls

Querying for archives with a non-200 status code on the CDX server API

waybackpy --url archive.org --user-agent user-agent-example --cdx --filter !statuscode:200 --cdx-print archiveurl --cdx-print statuscode

[Packaged] - Nope

Additional Information

Docs for CLI Usage: https://github.com/akamhy/waybackpy/wiki/CLI-docs

Video for CLI Usage: https://asciinema.org/a/469890

Activities

g0tmi1k

g0tmi1k

2023-08-16 13:41

administrator   ~0018338

@kali-team, please could this be packaged up.
@author, If you want to help the packaging process, you can check the documentation here ~ https://www.kali.org/docs/development/public-packaging

Arszilla

Arszilla

2024-04-17 18:43

reporter   ~0019154

I have drafted a package here: https://gitlab.com/Arszilla/waybackpy

I had to skip the tests that the package has due to some issues. I have introduced superficial tests in their place instead. Please let me know if you require me to edit the the package further.

daniruiz

daniruiz

2024-04-19 09:19

manager   ~0019163

This tools is now packaged!
https://gitlab.com/kalilinux/packages/waybackpy/

Issue History

Date Modified Username Field Change
2022-03-31 04:54 akamhy New Issue
2022-04-03 18:01 steev Assigned To => g0tmi1k
2022-04-03 18:01 steev Status new => assigned
2022-04-29 13:08 g0tmi1k Assigned To g0tmi1k =>
2022-05-04 13:16 g0tmi1k Summary waybackpy, CLI tool that interfaces the Wayback Machine API => waybackpy - CLI tool that interfaces the Wayback Machine API
2023-08-16 13:34 g0tmi1k Status assigned => new
2023-08-16 13:41 g0tmi1k Status new => acknowledged
2023-08-16 13:41 g0tmi1k Category New Tool Requests => Queued Tool Addition
2023-08-16 13:41 g0tmi1k Note Added: 0018338
2024-04-17 18:43 Arszilla Note Added: 0019154
2024-04-19 09:19 daniruiz Note Added: 0019163
2024-04-19 09:19 daniruiz Assigned To => daniruiz
2024-04-19 09:19 daniruiz Status acknowledged => resolved
2024-04-19 09:19 daniruiz Resolution open => fixed
2024-04-19 09:19 daniruiz Fixed in Version => 2024.2