Movatterモバイル変換

Showing 10 of 27 repositories

scrapy Public
Scrapy, a fast high-level web crawling & scraping framework for Python.
scrapy/scrapy’s past year of commit activity
Python 54,566BSD-3-Clause 10,709 438 (19 issues need help) 187 UpdatedMar 17, 2025
queuelib Public
Collection of persistent (disk-based) and non-persistent (memory-based) queues for Python
scrapy/queuelib’s past year of commit activity
Python 274BSD-3-Clause 55 3 2 UpdatedMar 10, 2025
cssselect Public
CSS Selectors for Python
scrapy/cssselect’s past year of commit activity
Python 293 61 17 4 UpdatedMar 10, 2025
scrapyd-client Public
Command line client for Scrapyd server
scrapy/scrapyd-client’s past year of commit activity
Python 773BSD-3-Clause 145 5 0 UpdatedMar 8, 2025
protego Public
A pure-Python robots.txt parser with support for modern conventions.
scrapy/protego’s past year of commit activity
DIGITAL Command Language 60BSD-3-Clause 28 5 (1 issue needs help) 0 UpdatedMar 8, 2025
parsel Public
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
scrapy/parsel’s past year of commit activity
Python 1,202BSD-3-Clause 150 31 (1 issue needs help) 12 UpdatedMar 8, 2025
itemloaders Public
Library to populate items using XPath and CSS with a convenient API
scrapy/itemloaders’s past year of commit activity
Python 47BSD-3-Clause 16 17 4 UpdatedMar 8, 2025
scrapy.org Public
The scrapy.org website
scrapy/scrapy.org’s past year of commit activity
HTML 62 141 1 1 UpdatedMar 7, 2025
scrapyd Public
A service daemon to run Scrapy spiders
scrapy/scrapyd’s past year of commit activity
Python 3,013BSD-3-Clause 574 8 0 UpdatedFeb 19, 2025
w3lib Public
Python library of web-related functions
scrapy/w3lib’s past year of commit activity
Python 400BSD-3-Clause 108 12 (1 issue needs help) 4 UpdatedFeb 17, 2025