webscraping
Here are 10,088 public repositories matching this topic...
Language:All
Sort:Most stars
🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data
- Updated
Feb 20, 2026 - TypeScript
Create agents that monitor and act on your behalf. Your agents are standing by!
- Updated
Feb 20, 2026 - Ruby
An autonomous agent that conducts deep research on any data using any LLM providers.
- Updated
Feb 19, 2026 - Python
✨ The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes ✨
- Updated
Feb 20, 2026 - TypeScript
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
- Updated
Feb 18, 2026 - Python
List of libraries, tools and APIs for web scraping and data processing.
- Updated
Jan 13, 2026 - Makefile
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
- Updated
Jun 9, 2025 - Python
🦊 Anti-detect browser
- Updated
Feb 20, 2026 - C++
Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️♂️ when scraping the web?
- Updated
Jul 17, 2024 - JavaScript
Self-hosted webscraper.
- Updated
Oct 12, 2025 - TypeScript
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
- Updated
Jan 20, 2026 - Python
Undetected version of the Playwright testing and automation library.
- Updated
Feb 19, 2026 - JavaScript
Web Scraper in Go, similar to BeautifulSoup
- Updated
Nov 2, 2023 - Go
Vision utilities for web interaction agents 👀
- Updated
Nov 25, 2024 - Jupyter Notebook
The web scraping open project repository aims to share knowledge and experiences about web scraping with Python
- Updated
May 27, 2024
Make your job hunt easy by automating your application process with this Auto Applier
- Updated
Jan 23, 2026 - Python
Persistent HTTP cache for python requests
- Updated
Feb 16, 2026 - Python
LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping
- Updated
Nov 26, 2024 - Python
Improve this page
Add a description, image, and links to thewebscraping topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with thewebscraping topic, visit your repo's landing page and select "manage topics."