Movatterモバイル変換

protego Public
A pure-Python robots.txt parser with support for modern conventions.
scrapy/protego’s past year of commit activity
DIGITAL Command Language 71BSD-3-Clause 28 7 (3 issues need help) 1 UpdatedNov 8, 2025
queuelib Public
Collection of persistent (disk-based) and non-persistent (memory-based) queues for Python
scrapy/queuelib’s past year of commit activity
Python 285BSD-3-Clause 55 3 3 UpdatedNov 8, 2025
itemloaders Public
Library to populate items using XPath and CSS with a convenient API
scrapy/itemloaders’s past year of commit activity
Python 47BSD-3-Clause 16 18 (1 issue needs help) 5 UpdatedNov 8, 2025
itemadapter Public
Common interface for data container classes
scrapy/itemadapter’s past year of commit activity
Python 68BSD-3-Clause 12 10 3 UpdatedNov 7, 2025
cssselect Public
CSS Selectors for Python
scrapy/cssselect’s past year of commit activity
Python 302 61 18 5 UpdatedNov 7, 2025
w3lib Public
Python library of web-related functions
scrapy/w3lib’s past year of commit activity
Python 411BSD-3-Clause 106 11 (1 issue needs help) 6 UpdatedNov 7, 2025
parsel Public
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
scrapy/parsel’s past year of commit activity
Python 1,287BSD-3-Clause 154 33 14 UpdatedNov 6, 2025
scrapyd Public
A service daemon to run Scrapy spiders
scrapy/scrapyd’s past year of commit activity
Python 3,074BSD-3-Clause 576 7 0 UpdatedNov 6, 2025
scrapy Public
Scrapy, a fast high-level web crawling & scraping framework for Python.
scrapy/scrapy’s past year of commit activity
Python 58,929BSD-3-Clause 11,145 465 (21 issues need help) 220 UpdatedOct 27, 2025
sphinx-scrapy Public
Sphinx extension for documentation in the Scrapy ecosystem
scrapy/sphinx-scrapy’s past year of commit activity
Python 1BSD-3-Clause 1 0 0 UpdatedSep 16, 2025