Description
Scrapy is a fast high-level web crawling and web scraping framework, used to
crawl websites and extract structured data from their pages. It can be used for
a wide range of purposes, from data mining to monitoring and automated testing.
For more information including a list of features check the Scrapy homepage at:
http://scrapy.org
Code Quality Rank:
L4
Programming language: Python
License: BSD 3-clause "New" or "Revised" License
Scrapy alternatives and similar packages
Based on the "Web Crawling" category.
Alternatively, view Scrapy alternatives based on common mentions on social networks and blogs.
-
DISCONTINUED.
A Powerful Spider(Web Crawler) System in Python.
-
Pythonic HTML Parsing for HumansTM
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
Promo
www.influxdata.com
-
Visual scraping for Scrapy
-
A Python library for automating interaction with websites.
-
A simple, Pythonic library for browsing the web without a standalone web browser.
-
简单易用的Python爬虫框架,QQ交流群:597510560
-
-
DISCONTINUED.
A high-level distributed crawling framework.
-
-
A pure-python HTML screen-scraping library
-
Web crawling framework based on asyncio.
-
Google Search Results via SERP API pip Python Package
-
Minimalist and powerful Web Crawler.
-
-
A Python feed reader library.
-
The simple, easy to use command line web crawler.
-
Pythonic Crawling / Scraping Framework based on Non Blocking I/O operations.
-
Brownant is a web data extracting framework.
-
PyQuery-based scraping micro-framework.
-
Screen scraping and web crawling framework
-
Python library that finds the size / type of an image given its URI by fetching as little as needed
-
This a is mirror of Gitlab repository. Open your issues and pull requests there.
* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest.
Do you think we are missing an alternative of Scrapy or a related project?
Add another 'Web Crawling' Package
