scraping-websites
Here are 2,006 public repositories matching this topic...
Language:All
Sort:Most stars
Declarative web scraping
- Updated
Sep 11, 2025 - Go
A Python module to bypass Cloudflare's anti-bot page.
- Updated
Oct 14, 2023 - Python
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)
- Updated
Dec 10, 2025 - JavaScript
Crawly, a high-level web crawling & scraping framework for Elixir.
- Updated
Jul 16, 2025 - Elixir
Generate Free Edu Mail(s) within minutes
- Updated
Dec 14, 2022 - Python
🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON.
- Updated
Apr 5, 2024 - TypeScript
Extract structured data from web sites. Web sites scraping.
- Updated
Mar 7, 2023 - Go
Build Bots, Scrape a website or use an API to solve a problem.
- Updated
Oct 3, 2023 - Python
译文:Puppeteer 与 Chrome Headless —— 从入门到爬虫
- Updated
Nov 22, 2018 - JavaScript
OSINT tool - gets data from services like shodan, censys etc. in one app
- Updated
May 4, 2023 - Python
A universal web-util for PHP.
- Updated
Apr 9, 2024 - PHP
Simple yet powerful automation stuffs.
- Updated
Jan 31, 2021 - Python
Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.
- Updated
Nov 12, 2025
A webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)
- Updated
Dec 1, 2025 - JavaScript
🧶 Extract data from any website without code, just clicks.
- Updated
Apr 15, 2021 - TypeScript
Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup
- Updated
Oct 20, 2025 - Python
Library for Rapid (Web) Crawler and Scraper Development
- Updated
Aug 5, 2025 - PHP
Pythonic HTML Parsing for Humans™
- Updated
Jun 19, 2024 - Python
An Aggregator Engine for searching and downloading movies free - NO ADs!
- Updated
May 22, 2023 - Go
Turn Webpage to LLM friendly input text. Similar to Firecrawl and Jina Reader API. Makes RAG, AI web scraping, image & webpage links extraction easy.
- Updated
Nov 26, 2025 - Python
Improve this page
Add a description, image, and links to thescraping-websites topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with thescraping-websites topic, visit your repo's landing page and select "manage topics."