A fast, concurrent CLI tool to fetch archived URLs from the Wayback Machine CDX API.
go install github.com/AliHzSec/archivefetch@latest
archivefetch -d example.com
| Flag | Short | Default | Description |
|---|---|---|---|
-domain |
-d |
— | Target domain (required) |
-list |
-l |
— | File with list of domains (one per line) |
-subs |
-s |
false | Include subdomains |
-threads |
-t |
10 | Concurrent fetch threads |
-retry |
-r |
0 | Max retries per request |
-page-size |
-ps |
50 | CDX page size (1–50) |
-timeout |
-T |
60 | HTTP timeout in seconds |
-proxy |
-p |
— | HTTP/SOCKS5 proxy |
-output |
-o |
stdout | Output file path |
-silent |
-S |
false | Suppress logs, print URLs only |
# Basic fetch archivefetch -d example.com # Include subdomains, save to file archivefetch -d example.com -s -o example_urls.txt # Multiple domains from file archivefetch -l domains.txt -s -o results.txt # With proxy and retries archivefetch -d example.com -p "http://127.0.0.1:8080" -r 3 # Silent mode (pipe-friendly) archivefetch -d example.com -S | grep "\.php" # Increase threads for faster fetching archivefetch -d example.com -t 20 -o output.txt