scraper-python

Star

Here are 60 public repositories matching this topic...

Language:All

Filter by language

All60 Python53 HTML1 Jupyter Notebook1 Tcl1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

oxylabs /quick-start-guide

Star518

Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.

scraper scraping web-scraper web-scraping scrapers scraping-websites scraper-api oxylabs scraper-python

UpdatedJun 26, 2025

oxylabs /Python-Web-Scraping-Tutorial

Star285

In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex.

python crawler scraping web-scraping python-web-crawler webscraping web-crawler-python python-web-scraper python-projects web-scraping-python github-python web-scraping-api scraper-python amazon-scraper-python json-database-python

UpdatedJun 26, 2025
Python

oxylabs /how-to-scrape-google-jobs

Star229

Learn how to build your own Google Jobs scraper that simultaneously scrapes Google Jobs for multiple search queries and geo-locations with Python and Oxylabs’ Google Jobs Scraper API.https://oxylabs.io/blog/how-to-scrape-google-jobs

python scraper web-scraping scraper-api google-scraping google-search-api serp-scraping google-search-scraper scraper-python serp-scraper-api

UpdatedJun 26, 2025
Python

aalapd /wormpy

Star55

A simple Python-based tool designed to scrape websites for content.

python webscraper scraper-python

UpdatedOct 4, 2024
Python

oxylabs /Rotating-Proxies-With-Python

Star37

Learn about how to rotate proxies by using Python.

python proxy scraping proxies rotating-proxy web-scraping proxy-list python-web-crawler web-proxy socks5-server socks5-proxy proxy-rotator web-proxies scraper-python proxy-list-github socks5-proxy-list python-image-scraper json-database-python

UpdatedJun 26, 2025
Python

Decodo /Python-scraper-tutorial

Star30

A short introduction to scraping with Python with given steps and an example scraper script.

python learning crawler data-science data-mining scraping web-scraping beautifulsoup python-web-crawler webscraping web-crawler-python python-web-scraper python-projects web-scraping-python github-python web-scraping-api scraper-python json-database-python

UpdatedMay 14, 2025
Python

oxylabs /Pagination-With-Python

Star23

A guide on how to deal with pagination via Python.

python pagination python-web-crawler webscraping python-ecommerce github-python scraper-python python-image-scraper serp-api-python amazon-scraper-python json-database-python

UpdatedJun 26, 2025
Python

oxylabs /selenium-proxy-integration-python

Star15

Tutorial for integrating Oxylabs' Residential Proxies with Selenium in Python

python proxy selenium proxy-server rotating-proxy proxy-list python-web-crawler web-proxy socks5-server proxy-site proxy-rotator webproxy python-ecommerce residential-proxy antidetect-browser github-python scraper-python proxy-list-github socks5-proxy-list serp-api-python

UpdatedJun 26, 2025
Python

Kourva /Tscraper

Star12

Automated Telegram Scraper that scrapes data when you join the groups...

telegram-api python3 telegram-scraper telegram-selfbot scraper-tools scraper-python

UpdatedAug 28, 2024
Python

CDUT-AI-Club /Web-Scraping-Journey-with-Python

Star6

本项目计划用于2024成都理工大学CDUT人工智能协会技术培训使用

python beginner selenium-python crawler-python scraper-python

UpdatedOct 3, 2024
Python

TheLovinator1 /sitemap-parser

Sponsor

Star5

This Python library is designed to scrape sitemaps from websites, providing a simple and efficient way to gather information about the structure of a website.

sitemap scraper hacktoberfest httpx scraper-python

UpdatedFeb 10, 2025
Python

oxylabs /how-to-parse-xml-in-python

Star4

Follow this in-depth technical tutorial to learn how to parse XML data in Python, what libraries you should use, how to handle invalid XML, and more.

python xml-parsing xml-parser xml-document python-parser python-ecommerce scraper-python python-image-scraper scrape-news-articles-python web-scraping-with-python-amazon serp-api-python web-scraping-python-projects amazon-scraper-python json-database-python

UpdatedJun 26, 2025
Python

MuhammadAhmed-0 /search-scraper

Star4

This Python-based tool scrapes Google search results and presents the top 10 results along with their URLs. Useful for SEO optimization and content writing.

search scraper google serp scraper-engine google-search-using-python google-search-scraper scraper-python google-serp-scraper google-serp-scraping