一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

• UpdatedDec 25, 2023
• Python

Pythonic HTML Parsing for Humans™

• UpdatedApr 16, 2024
• Python

「DLsite 同人作品重命名工具」依据 RJ|VJ|BJ 号从 dlsite.com 爬取 "标题" 和 "社团" 等信息，按照自定义模板对文件夹批量格式化命名，并将文件夹封面修改为作品封面。

• UpdatedOct 8, 2024
• Python

爬虫学习仓库，适合零基础的人学习，对新手比较友好

• UpdatedOct 10, 2020
• Python

智能云爬虫Demo

• UpdatedAug 16, 2017
• HTML

spider for chinese medical websites with wechat notification enabled

• UpdatedMay 24, 2017
• Python

stock market predictions using sentiment analysis, a deep learning project(data and news based on pakistani stock exchange and news(Dawn news))

• UpdatedOct 14, 2020
• Jupyter Notebook

Python tool for scraping any timetable page on the University of Aveiro's academic portal (PACO) and exporting it to different formats

• UpdatedJan 30, 2020
• Python

Twitter Scraper - Scrape tweets for a user or a #hashtag.

• UpdatedJan 2, 2022
• Python

Downloader for Free Books from Springer COVID-19 Package

• UpdatedMay 16, 2020
• Python

URL Feature extraction and Engineering aided with Classification via Neural Networks

• UpdatedDec 11, 2021
• Python

[NOT MAINTAINED] Job/Occupation data scraping tool that uses scrapy and pyquery

• UpdatedMay 13, 2017
• Python

Selenium with ChromeDrive/PhantomJS; Crawler with BeautifulSoup4, Scrapy, PyQuery

• UpdatedMay 3, 2018
• Python

A webscrapper that can scrape bbcnews using Scrapy and mongoDB

• UpdatedDec 22, 2018
• Python

百度贴吧极速签到,200个吧用时1.6秒,简单直接

• UpdatedNov 18, 2017
• Python

Simple API scrapper on LyricFInd 🎹

• UpdatedSep 24, 2024
• Python

Python网络爬虫与信息提取

• UpdatedDec 27, 2020
• Python

CNN Website Scraping Using Python

• UpdatedJan 8, 2024
• Python

Learn to parse HTML using PyQuery, a Python library for web scraping and manipulating HTML.

• UpdatedFeb 11, 2025
• Python

complete guide to scrape almost any website

• UpdatedFeb 17, 2021
• Python