🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data

• UpdatedFeb 20, 2026
• TypeScript

Python scraper based on AI

• UpdatedFeb 16, 2026
• Python

Open-source, production-grade web scraping engine built for LLMs. Scrape and crawl the entire web, clean markdown, ready for your agents.

• UpdatedFeb 2, 2026
• TypeScript

AI based web-wrapper for web-content-extraction

• UpdatedFeb 6, 2023
• Python

qcrawl - fast async web crawling & scraping framework for Python.

• UpdatedDec 7, 2025
• Python

Using LLMs and AI browser automation to robustly extract web data

• UpdatedSep 30, 2025
• TypeScript

The this.url class is designed to fetch and parse URL data, returning an object with structured information that can then be used for machine learning algorithms in a database or other storage.

• UpdatedAug 26, 2025
• JavaScript

Quick guide with code example how to use Java for web scraping

• UpdatedDec 18, 2024

GNewsScraper is a TypeScript package that scrapes article data from Google News based on a keyword or phrase. It returns the results as an array of JSON objects, making it convenient to access and use the scraped information

• UpdatedAug 19, 2023
• TypeScript

An API wrapper for Scrappey.com written in Node.js (cloudflare bypass & solver)

• UpdatedJan 10, 2024
• JavaScript

AI-based web extractor

• UpdatedFeb 25, 2023
• Python

Open-source web crawler

• UpdatedJul 21, 2018
• Python

The Tableau Web Data Connector for Facebook Insights API

• UpdatedJun 26, 2017
• JavaScript

Java Framework which is used by the Web Data Commons project to extract Microdata, Microformats and RDFa data, Web graphs, and HTML tables from the web crawls provided by the Common Crawl Foundation.

• UpdatedDec 13, 2022
• Java

A pipeline to scrape, extract, and analyze book data from web pages to insights.

• UpdatedJan 1, 2026
• HTML

RealShotPDF is a Chrome extension designed to simplify the process of creating PDF documents from web content. The extension allows users to navigate through selected webpages, parse and display links in a tree view, and generate PDFs for the chosen pages. It operates locally without sending any data to external servers.

• UpdatedMar 1, 2024
• TypeScript

Lightfeed SDK to search and filter web data

• UpdatedJun 7, 2025
• Python

OXPath from Oxford

• UpdatedMay 20, 2022
• Java

High-performance HTML to Markdown converter with full GitHub Flavored Markdown support. Written in Rust, available for Node.js and as a native Rust crate.

• UpdatedJan 29, 2026
• Rust

This repository contains the code and data download links to reproduce the building process of the 2021 Schema.org Table Corpus.

• UpdatedMay 12, 2021
• Python