web-scrapping
Here are 214 public repositories matching this topic...
Language:All
Sort:Most stars
AgentQL is a suite of tools for connecting your AI to the web. Featuring a query language and Playwright integrations for interacting with elements and extracting data quickly, precisely, and at scale. Includes REST API, Python and JavaScript SDKs, browser debugger.
- Updated
Mar 19, 2025 - Python
The NSE has a website which displays the option chain in near real-time. This program retrieves this data from the NSE site and then generates useful analysis of the Option Chain for the specified Index or Stock. It also continuously refreshes the Option Chain and visually displays the trend in various indicators useful for Technical Analysis.
- Updated
Oct 16, 2024 - Python
Proxy List Scrapper
- Updated
Feb 1, 2023 - Python
Boost website hits by generating requests from multiple proxy IPs.
- Updated
Feb 26, 2024 - Python
All-in-one Web Scrapper for Python
- Updated
Jul 6, 2022 - Python
Unofficial python api for Erowid, PsychonautWiki and AskTheCaterpillar
- Updated
Dec 29, 2023 - Python
Builds a Tagalog dictionary by collecting Tagalog words from tagalog.pinoydictionary.com
- Updated
Feb 19, 2023 - Python
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
- Updated
Jul 21, 2022 - Python
🍀 Scraps data from Leafly and collects amazing weed-based meta-data.
- Updated
Sep 22, 2022 - Python
Evaluate JavaScript on a URL through headless Chrome browser.
- Updated
Jun 18, 2021 - JavaScript
This Is A Web Scraping Projects With Covid-19 Data From 2 Very Popular & Authentic Websites
- Updated
Jul 4, 2023 - Jupyter Notebook
This repository contains the code for completely scraping the yellow pages website to get the details of all the categories from all the cities in America and then turning all of the data into an api to be used later.
- Updated
Jun 6, 2022 - CSS
Unoffical api to get comic books from various publishers. Published on NPM !
- Updated
Jan 30, 2024 - JavaScript
I was a little lazy in downloading the series I wanted. So I made it automatic.
- Updated
May 22, 2023 - Python
Get all the resources like Notes and Notebooks provided in CampusX Courses.
- Updated
May 28, 2024 - Jupyter Notebook
This Repository is for scraping jobs from Indeed
- Updated
May 16, 2024 - Jupyter Notebook
AgentQL’s integrations with workflow automation tools and AI agent frameworks let you extract structured data from web pages using queries or natural language and interact with the web with Playwright. Resilient, fast, and AI-ready.
- Updated
Mar 19, 2025 - Jupyter Notebook
🤖 An RPA-based tool for extracting information over JUCESP.
- Updated
Oct 5, 2022 - Python
Model Context Protocol server that integrates AgentQL's data extraction capabilities.
- Updated
Mar 19, 2025 - JavaScript
Improve this page
Add a description, image, and links to theweb-scrapping topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with theweb-scrapping topic, visit your repo's landing page and select "manage topics."