Logo of the project Logo of the project
This Selenium-based firmware scraper gathers firmware data from 18 vendors. Our automated solution scrapes metadata and downloads corresponding firmwares. The results can be used for InfoSec research.
git clone https://github.com/amosproj/amos2022ws01-firmware-scraper # or download and unpack .zip amos2022ws01-firmware-scraper cd amos2022ws01-firmware-scraper ./install.sh source .venv/bin/activate # Make sure MySQL server is running sudo systemctl start mysql.service export MYSQL_USER=<your username> export MYSQL_PASSWORD=<your password> export LOG_LEVEL=DEBUG # Start the scraper: python -m src.core
Requirements: Docker should be installed on your machine.
git clone https://github.com/amosproj/amos2022ws01-firmware-scraper #or download and unpack .zip amos2022ws01-firmware-scraper cd amos2022ws01-firmware-scraper docker-compose up --build