scraping-data

Star

Here are 50 public repositories matching this topic...

Language:All

Filter by language

All50 Python20 Jupyter Notebook11 HTML5 JavaScript5 PHP2 C#1 Go1 Kotlin1 Vue1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

pavlovtech /WebReaper

Star133

Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.

parser crawler scraper parsing scraping webcrawler webscraping scraping-websites datamining scraping-api scraping-tool scraping-web scraping-data

UpdatedOct 29, 2024
C#

hhuayuan /spiderbuf

Star121

Spiderbuf 是一个专注于 Python 爬虫练习的网站。提供丰富的爬虫教程、爬虫案例解析和爬虫练习题。Python爬虫开发强化练习，在矛与盾的攻防中不断提高技术水平，通过大量的爬虫实战掌握常见的爬虫与反爬套路。引导式爬虫案例 + 免费爬虫视频教程，以闯关的形式挑战各个爬虫任务，培养爬虫开发的直觉及经验，验证自身爬虫开发与反爬虫实力的时候到了。

python crawler spider captcha cookie scraping cookies selenium requests xpath crawlers scraping-websites scraping-python crawler-python scraping-web scraping-data js-reverse spiderbuf

UpdatedNov 17, 2025
Python

ScrapingAnt /amazon_scraper

Star88

Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt

data-mining scraper js amazon web-crawler scraping node-js scraping-websites web-crawling price-scraper amazon-scraper scraping-api scraping-python price-scraping scraping-web web-crawlers scraping-data amazon-scraping-library scrape-products

UpdatedMar 15, 2024
JavaScript

codegratia /react-node-web-scraper

Star51

Final Year project, scraping data of e-commerce stores and display in ReactJS app.

react nodejs javascript cheerio scraping web-scraper scraping-websites price-comparison scraping-web scraping-data web-scraping-project

UpdatedSep 21, 2024
JavaScript

alext234 /coronavirus-stats

Star49

Automatically scrape data and statistics on Coronavirus to make them easily accessible in CSV format

data-science pipeline jupyter-notebook health usa australia stats china south-korea singapore cdc europe italy coronavirus wuhan-virus scraping-data covid-19

UpdatedJul 23, 2023
Jupyter Notebook

lspahija /torchestrator

Star45

Spin up Tor containers and then proxy HTTP requests via these Tor instances

kotlin docker proxy scraping proxy-server tor proxies scrapy proxypool proxy-list scraping-websites privoxy data-scraping proxy-checker free-proxies scraping-tool proxy-scraper proxies-https-traffic proxies-generator scraping-data

UpdatedApr 12, 2021
Kotlin

officialpm /scrape-amazon

Star39

🤩 Python Package for Scraping Amazon Product Reviews ✨

data product amazon reviews scrape beautifulsoup hacktoberfest beautifulsoup4 amazon-reviews scraping-python scraping-web web-crawlers scraping-data amazon-scraping-library scraping-apis

UpdatedDec 22, 2022
Python

ScrapingAnt /zoominfo_scraper

Star38

Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt

python scraper web-crawler scraping scraping-websites web-crawling datamining zoominfo-client web-crawler-python leadgen leadgeneration scraping-api scraping-tool scraping-data web-harvesting

UpdatedApr 26, 2021
Python

Decodo /SERP-Scraping-API

Star20

SERP Scraping API code examples for Python, PHP and Node.js

data-mining scraper google yandex bing scraping scrape baidu serp google-scraper data-scraping serp-api scraping-api scraping-web google-scraping scraping-data serpapi python-scraping serp-scraper serp-scraping

UpdatedNov 26, 2025
PHP

ScrapingAnt /alibaba_scraper

Star17

Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt

python scraper web-crawler scraping scraping-websites web-crawling datamining web-crawler-python price-scraper scraping-api scraping-tool price-scraping scraping-web scraping-data alibaba-scraper

UpdatedMay 21, 2024
Python

archana1998 /Gradient-Ascent_FK-GRiD

Star7

Submission for the Flipkart GRiD 2.0 hackathon under the track "Fashion Intelligence Systems"

ratings fashion clustering yolo object-detection recommendation-algorithms flipkart gradient-ascent fashion-ai fashion-recommendation scraping-data feature-encodings fashion-portals ecommerce-sites popularity-metric lagging-products

UpdatedAug 9, 2020
Python

gayanukabulegoda /Web-Scraping-Starter-Kit

Sponsor

Star7

Repository designed to help freshers easily grasp the basics of web scripting, offering simple guides and examples to build a strong foundation.

python scraping web-scraper python3 web-scraping scrape web-scrapping web-scraping-tutorials scrap-data python-web-scraper scraping-python scraping-images scraping-web web-scrapper-python scraping-data web-scraping-python web-scraping-project simple-scraping

UpdatedJan 28, 2025
Python

jaeyk /digital_data_collection_workshop

Star7

Digital Data Collection Workshop

scraping-websites scraping-api scraping-tool scraping-bot scraping-data

UpdatedSep 30, 2020
HTML

drisskhattabi6 /AI-Scraper

Star6

AI Scraper : scrap and extract data from website in any format (CSV, JSON, HTML...) using Selenium or Crawl4ai, and using Ollama or Sambanova API, and using Streamlit for UI as chatbot