Repository files navigation

Scrapy is a BSD-licensed fast high-level web crawling and web scraping framework, used tocrawl websites and extract structured data from their pages. It can be used fora wide range of purposes, from data mining to monitoring and automated testing.

Scrapy is maintained byZyte (formerly Scrapinghub) andmany othercontributors.

Check the Scrapy homepage athttps://scrapy.org for more information,including a list of features.

• Python 3.9+
• Works on Linux, Windows, macOS, BSD

The quick way:

pip install scrapy

See the install section in the documentation athttps://docs.scrapy.org/en/latest/intro/install.html for more details.

Documentation is available online athttps://docs.scrapy.org/ and in thedocsdirectory.

You can checkhttps://docs.scrapy.org/en/latest/news.html for the release notes.

Seehttps://scrapy.org/community/ for details.

Seehttps://docs.scrapy.org/en/master/contributing.html for details.

Please note that this project is released with a ContributorCode of Conduct.

By participating in this project you agree to abide by its terms.Please report unacceptable behavior toopensource@zyte.com.

Seehttps://scrapy.org/companies/ for a list.

Seehttps://scrapy.org/support/ for details.