Scrapy

PyPI Version Supported Python Versions Ubuntu macOS Windows Coverage report Conda Version Ask DeepWiki

Scrapy is a web scraping framework to extract structured data from websites. It is cross-platform, and requires Python 3.9+. It is maintained by Zyte (formerly Scrapinghub) and many other contributors.

Install with:

pip install scrapy

And follow the documentation to learn how to use it.

If you wish to contribute, see Contributing.