List of libraries, tools and APIs for web scraping and data processing.
SpideyX a multipurpose Web Penetration Testing tool with asynchronous concurrent performance with multiple mode and configurations.
📱 A utility for downloading Android apps from the Google Play Store and Xiaomi App Store (the Chinese App Store).
An declarative and easy to use web crawler and scraper in C#
🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖
Web crawling & scraping framework for Node.js on top of headless Chrome browser
🕷️ Easily scrap the web for torrent and media files.
🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖
Firetastic - a tool for automating interaction with FireTV apps
A Website Spider/Crawler, Python 3.x
AI Scraper : scrap and extract data from website in any format (CSV, JSON, HTML...) using Selenium or Crawl4ai, and using Ollama or Sambanova API, and using Streamlit for UI as chatbot
List of best web crawlers to extract data from the web. Find web crawling tools for different needs.
This python script crawls course title, ratings, description and instructors from coursera.org
A web Crowler design , basic setup c++
A spam spider which is targeting 'Untitled' spam pages from the Google search results.
Firetastic - a tool for automating interaction with FireTV apps
By scraping leads from Google Maps, you can build a database of potential customers who have shown interest in products or services related to your business. This data can be used for targeted marketing campaigns, email outreach, or sales prospecting.
Tourist is a simple tool that allows you to collect console messages, errors, unsuccessful requests of all your pages after the DOM loading with authentication support.
The DirFinder tool is user for bruteforce directory with dedicated Wordlist is very simple user-friendly to use
Add a description, image, and links to the crawling-tool topic page so that developers can more easily learn about it.
To associate your repository with the crawling-tool topic, visit your repo's landing page and select "manage topics."