Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings
scrapy

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings
@scrapy

Scrapy project

An open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.

PinnedLoading

  1. scrapyscrapyPublic

    Scrapy, a fast high-level web crawling & scraping framework for Python.

    Python 58.9k 11.1k

  2. scrapydscrapydPublic

    A service daemon to run Scrapy spiders

    Python 3.1k 576

  3. parselparselPublic

    Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

    Python 1.3k 155

  4. w3libw3libPublic

    Python library of web-related functions

    Python 411 106

  5. protegoprotegoPublic

    A pure-Python robots.txt parser with support for modern conventions.

    DIGITAL Command Language 71 28

  6. itemadapteritemadapterPublic

    Common interface for data container classes

    Python 68 12

Repositories

Loading
Type
Select type
Language
Select language
Sort
Select order
Showing 10 of 29 repositories
  • scrapy Public

    Scrapy, a fast high-level web crawling & scraping framework for Python.

    scrapy/scrapy’s past year of commit activity
    Python 58,865BSD-3-Clause 11,139 465(21 issues need help) 217 UpdatedOct 27, 2025
  • scrapyd Public

    A service daemon to run Scrapy spiders

    scrapy/scrapyd’s past year of commit activity
    Python 3,074BSD-3-Clause 576 7 1 UpdatedOct 27, 2025
  • itemadapter Public

    Common interface for data container classes

    scrapy/itemadapter’s past year of commit activity
    Python 68BSD-3-Clause 12 10 2 UpdatedSep 17, 2025
  • cssselect Public

    CSS Selectors for Python

    scrapy/cssselect’s past year of commit activity
    Python 302 61 18 4 UpdatedSep 16, 2025
  • sphinx-scrapy Public

    Sphinx extension for documentation in the Scrapy ecosystem

    scrapy/sphinx-scrapy’s past year of commit activity
    Python 1BSD-3-Clause 1 0 0 UpdatedSep 16, 2025
  • parsel Public

    Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

    scrapy/parsel’s past year of commit activity
    Python 1,285BSD-3-Clause 155 33 12 UpdatedSep 15, 2025
  • itemloaders Public

    Library to populate items using XPath and CSS with a convenient API

    scrapy/itemloaders’s past year of commit activity
    Python 47BSD-3-Clause 16 18(1 issue needs help) 4 UpdatedSep 5, 2025
  • scrapy-lint Public

    A linter for Scrapy projects.

    scrapy/scrapy-lint’s past year of commit activity
    Python 20MIT 4 42(2 issues need help) 0 UpdatedAug 16, 2025
  • scrapyd-client Public

    Command line client for Scrapyd server

    scrapy/scrapyd-client’s past year of commit activity
    Python 777BSD-3-Clause 146 5 0 UpdatedAug 12, 2025
  • w3lib Public

    Python library of web-related functions

    scrapy/w3lib’s past year of commit activity
    Python 411BSD-3-Clause 106 11(1 issue needs help) 5 UpdatedAug 7, 2025

[8]ページ先頭

©2009-2025 Movatter.jp