🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

• UpdatedMar 17, 2025
• TypeScript

🕷️ An undetectable, powerful, flexible, high-performance Python library that makes Web Scraping easy again!

• UpdatedMar 18, 2025
• Python

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

• UpdatedFeb 3, 2025
• Python

Lightweight library for scraping web-sites with LLMs

• UpdatedFeb 10, 2025
• Python

➖ Stripped down, stable version of firecrawl optimized for self-hosting and ease of contribution. Billing logic and AI features are completely removed. Crawl and convert any website into LLM-ready markdown.

• UpdatedMar 17, 2025
• TypeScript

🔥 This repository contains complete application examples, including websites and other projects, developed using Firecrawl.

• UpdatedMar 17, 2025
• Python

⬇️ A simple all-in-one CLI tool to download EVERYTHING from a URL (like youtube-dl/yt-dlp, forum-dl, gallery-dl, simpler ArchiveBox). 🎭 Uses headless Chrome to get HTML, JS, CSS, images/video/audio/subtitles, PDFs, screenshots, article text, git repos, and more...

• UpdatedDec 26, 2024
• JavaScript

How to guides on web-crawling or scraping

• UpdatedJul 21, 2024

AI web scraper built with Crawl4AI for extracting structured leads data from websites.

• UpdatedFeb 13, 2025
• Python

Python, Javascript, and Rust libraries for the Spider Cloud API.

• UpdatedMar 11, 2025
• Python

A CLI tool and REST API that converts web content to clean Markdown, bypassing anti-scraping measures using headless browsers. Perfect for AI/LLM applications

• UpdatedFeb 2, 2025
• Go

This repository contains complete application examples, developed using Skrape.ai

• UpdatedJan 12, 2025

TypeScript/Node.js SDK to easily interact with the skrape.ai API

• UpdatedJan 8, 2025
• TypeScript

AI tools to enhance productivity and automate web-scraping

• UpdatedNov 22, 2024
• Jupyter Notebook