List of libraries, tools and APIs for web scraping and data processing.

• UpdatedOct 13, 2025
• Makefile

The All in One Framework to Build Undefeatable Scrapers

• UpdatedDec 17, 2025
• Python

a reliable high-level web crawling & scraping framework for Node.js.

• UpdatedMar 12, 2025
• JavaScript

Pythonic HTML Parsing for Humans™

• UpdatedJun 19, 2024
• Python

Lightweight web scraping toolkit for documents and structured data.

• UpdatedJan 10, 2024
• Python

Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis

• UpdatedAug 19, 2023
• Python

Serritor is an open source web crawler framework built upon Selenium and written in Java. It can be used to crawl dynamic web pages that require JavaScript to render data.

• UpdatedJul 7, 2022
• Java

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

• UpdatedJul 12, 2025
• TypeScript

Async fork of Python-TLS-Client with modern asyncio support, updated dependencies, and fixes for issues in the original abandoned library. Includes enhanced compatibility, stability improvements, and ongoing maintenance for Python 3.9–3.13.

• UpdatedNov 18, 2025
• Python

An API wrapper for Scrappey.com written in Python (cloudflare, datadome bypass & solver)

• UpdatedOct 10, 2025
• Python

ProxyCrawl PHP library for scraping and crawling websites

• UpdatedJul 3, 2023
• PHP

🚀 OMKAR TEMP MAIL HELPS YOU USE TEMPORARY EMAILS. 🤖

• UpdatedMar 5, 2024
• Python

An API wrapper for Scrappey.com written in Node.js (cloudflare bypass & solver)

• UpdatedJan 10, 2024
• JavaScript

A simple, easy to use, scalable scraping framework written in PHP

• UpdatedOct 19, 2020
• PHP

🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖

• UpdatedJul 16, 2023
• Python

Web scraping API to outsource tons of GET & xpath to cloud computing

• UpdatedJun 1, 2024
• Python

🚀 FINAL CODE FOR TUTORIAL ON HOW TO SOLVE CAPTCHA IN SELENIUM USING 2CAPTCHA 🤖

• UpdatedJul 16, 2023
• Python

✨ NodeJs crawling & scraping framework heavily inspired by Scrapy

• UpdatedJul 20, 2018
• JavaScript

A powerful web scraping library built with Playwright that provides a declarative, step-by-step approach to web automation and data extraction.

• UpdatedOct 30, 2025
• TypeScript

M.A. Thesis work, news scraping framework/pipeline using python, beautifulsoup, newspaper3k, flask and mongodb with a custom api.

• UpdatedJun 23, 2018
• Python