distributed-scraper

Star

Here are 6 public repositories matching this topic...

Language:All

Filter by language

All6 JavaScript2 Python2 Go1 Jupyter Notebook1

gosom /google-maps-scraper

Sponsor

Star2.2k

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

golang google-maps web-scraper web-scraping distributed-scraper distributed-scraping google-maps-scraping

UpdatedJun 14, 2025
Go

MorvanZhou /easy-scraping-tutorial

Star802

Simple but useful Python web scraping tutorial code.

crawler regex scraping crawling requests asyncio scrapy beautifulsoup distributed-scraper urllib

UpdatedApr 7, 2024
Jupyter Notebook

aaldaber /Distributed-Multi-User-Scrapy-System-with-a-Web-UI

Star114

Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner

python django mongodb rabbitmq scrapy distributed-scraper scrapyd scrapy-ui distributed-crawler

UpdatedMay 11, 2018
Python

nemo /scrape

Star65

Distributed Scraper

metadata scraper stdlib distributed-scraper

UpdatedApr 4, 2017
JavaScript

Peer 2 peer distributed/serverless computing solution.Define the problem , the way workers to solve it, code dependencies. Then the most difficult part is to find more workers/peers.. Example usecase : distributed web scraper