ROSS is a tool intended to make a GET request against any .onion and clearweb address.
This script allows you to make a GET request against an .onion URL. It retrieves the HTML source code to being analyzed later. For scraping the Tor network, Polipo and Tor proxies must be set beforehand.
You can use this guide to configure Tor + Polipo + Privoxy.
- Setting up
pyenvenvironment:
# initialize virtualenv pyenv virtualenv ross_env # activate virtualenv pyenv activate ross_env
Install dependencies:
pip install -r requirements.txt
Just type:
# help menu $ python ross.py -h # set 5 retries $ python ross.py https://metalerk.github.io --retry 5 --serve # start local webserver (images with relative paths are not shown) $ python ross.py https://metalerk.github.io --serve
Run tests:
python -m unittest discover -s tests
Usage: ross.py [OPTIONS] URL Options: --retry INTEGER Number of retries. --serve Start webserver. --port INTEGER Local webserver port. --use-proxies Start webserver. --save BOOLEAN Save to file. -h, --help Show this message and exit.
