python-web-scraping

Star

Here are 20 public repositories matching this topic...

Language:All

Filter by language

All20 Python16 HTML1 JavaScript1 Jupyter Notebook1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

omkarcloud /botasaurus

Sponsor

Star1.9k

The All in One Framework to Build Undefeatable Scrapers

anti-bot web-crawling bot-detection python-scraper anti-detect undetected scraping-framework undetectable python-web-scraper scraping-tool cloudflare-bypass scraping-python python-web-scraping anti-detection cloudflare-scrape bypass-cloudflare web-scraping-python undetected-chromedriver antidetect-browser anti-detect-browser

UpdatedMay 23, 2025
Python

thewebscraping /tls-requests

Star55

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

anti-bot-page anti-bot python-web-crawler python-crawler python-spider web-crawler-python web-spider python-scraper tls-client python-web-scraper cloudflare-bypass scraping-python python-web-scraping crawling-python web-scraping-python anti-bot-detection cf-clearance cloudflare-scraper web-scraping-api python-tls-client

UpdatedMay 18, 2025
Python

testdrivenio /concurrent-web-scraping

Star33

Building a Concurrent Web Scraper with Python and Selenium

web-scraping python-selenium python-concurrency python-web-scraping

UpdatedDec 22, 2021
HTML

epythonlab /github-search-tool

Star14

Github Repository Search Tool

github python github-api flask web-scraper scraping-websites github-scraping scraping-python python-web-scraping scraping-web python-scraping github-search-tool

UpdatedJan 14, 2024
Python

TerranKartikTellus /Web-Scraping

Star6

All about scraping domains from the 'World Wide Web'

website scraper web-scraper requests web-scraping web-scrapper beautifulsoup4 python-web-scraper timesjob python-web-scraping python-webscraping-application web-scraping-python

UpdatedMar 6, 2023
Python

oxylabs /how-to-make-web-scraping-faster

Star5

How to Make Web Scraping Faster - Python Tutorial

python web-scraping web-scraping-tutorials python-web-scraping github-python web-scraping-api web-scraping-with-python

UpdatedFeb 11, 2025
Python

Strykez /fastscrape

Star4

A simple web scraper built with python and beautifulfoup.

python scraper scraping web-scraping beautifulsoup scraping-websites python-web-scraper scraping-python python-web-scraping scraping-web python-scraping

UpdatedDec 20, 2022
Python

franckferman /OWASP-JuiceShop-AutoPwn

Star3

OWASP Juice Shop AutoPwn - Automated Challenge Solver for OWASP Juice Shop using Selenium & Requests

python scraper scraping selenium owasp python3 requests selenium-webdriver owasp-juice-shop owasp-top-10 owasp-top-ten owasp-top selenium-python selenium-automation juice-shop selenium-webscraper python-automation python-web-scraping juiceshop selenium-automation-project

UpdatedMar 8, 2025
Python

AyemunHossain /Scrapy-Web-Crawler-projects

Star3

Python crawler with Scrapy framework, which may help you to learn webscrapping.

scrapy-spider scrapy webscraping scrapy-crawler python-web-scraping scrapy-python python-webscraping-application

UpdatedJan 9, 2022
Python

oxylabs /how-to-build-web-scraper

Star1

Step by step guide to building a web scraper with Python

python parser python3 web-scraping url-scraper python-web-scraper python-web-scraping github-python build-a-web-scraper

UpdatedFeb 11, 2025
JavaScript

In this project, I used web scraping tools to extract data from daraz.pk, a popular e-commerce platform. Utilizing the BeautifulSoup and Selenium libraries in Python, I was able to efficiently navigate the website, extract valuable information on product listings, prices, and reviews, and store the data for further analysis.

selenium web-scraping html-parsing beautifulsoup selenium-webdriver scrapping-python selenium-python beautifulsoup4 python-web-scraping

UpdatedJan 4, 2025

jsvelu /DjangoWebScraper

Star1

A webscraper for FlipKart product Listing Using Django And BeautifulSoup4. The database used is SQLite with backend built in DJango and the frontend in HTML5 CSS JS. It is a project for scraping flipkart product listing.

python django scraping django-framework requests web-scraping beautifulsoup bs4 webscraping flipkart webapplication beautifulsoup4 python-web-scraping

UpdatedJan 16, 2023
Python

HercoZauZau /IMDb__WebScraping

Star1

Programa para extrair dados de filmes do IMDb e armazenar em Excel.

pandas imdb webscraping imdb-webscrapping exel python-web-scraping beautyfulsoup

UpdatedJun 8, 2023
Python

jaiswal-ashutosh /web_scraping_project

Star0

This repository contains a Python script for web scraping IMDb website to extract information about the top TV shows of all time. The script retrieves data such as title, year of release, genre, rating, runtime, number of votes, and cast. The extracted data is then saved in a CSV file for further analysis.

python-programming web-scraping data-scraping imdb-webscrapping pandas-library imdb-dataset python-web-scraping beautiful-soup-library

UpdatedApr 2, 2023
Jupyter Notebook

PartheOmkar /Web-Scraping

Star0

python database extract-data flipkart python-web-scraping flipkart-scraper-python

UpdatedFeb 17, 2021
Python

anuragmukherjee2001 /30-days-of-python

Star0

This repository contains 30 days of python coding challenge

python python-library python3 python-modules python-requests python-web-scraping python-regex

UpdatedDec 30, 2020
Python

ozanayrikan /amazon-scraper

Star0

A simple scraper using Selectorlib to extract product details from Amazon.com

data-extraction asin scrapper amazon-scraper python-web-scraping selectorlib amazon-asin

UpdatedJul 23, 2023
Python

MaxineXiong /Music-Events-Web-Scraper

Star0

A web scraping program built to extract attribute data on music events from a popular event ticketing website. The program collects event data based on the specified country and city, which is then exported to a CSV file for marketing emails and stored efficiently in a local PostgreSQL database.

python pandas-dataframe postgresql email-sender web-scraping psycopg2 postgresql-database smtplib data-migration csv-export beautifulsoup4 python-web-scraper python-web-scraping requests-python