Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

• UpdatedJul 18, 2025
• TypeScript

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

• UpdatedJul 18, 2025
• Python

Apify SDK monorepo

• UpdatedJul 16, 2025
• TypeScript

Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.

• UpdatedJul 18, 2025
• TypeScript

The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, local storage emulation, and actor event handling.

• UpdatedJul 18, 2025
• Python

House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.

• UpdatedApr 13, 2023
• JavaScript

This repo is a part of blog series on several web scraping projects where we will explore scraping techniques to crawl data from simple websites to websites using advanced protection.

• UpdatedApr 21, 2023
• Python

Amazon crawler - this configuration will extract items for a keywords that you will specify in the input, and it will automatically extract all pages for the given keyword. You can specify more keywords on the input for one run.

• UpdatedNov 25, 2020
• JavaScript

Apify API client for Python

• UpdatedJul 17, 2025
• Python

Scrape Tripadvisor restaurant, hotels, and places.

• UpdatedAug 17, 2022
• JavaScript

基于Apify+node+react搭建的有点意思的爬虫平台

• UpdatedMay 14, 2020
• JavaScript

Professional scrapers that provide full control to the users. Crawlee One builds on top of Crawlee and Apify and extends them with features for robust and highly configurable web scrapers.

• UpdatedMay 29, 2024
• TypeScript

Generic REST API for scraping websites. Drop-in replacement for ScrapingBee, ScrapingAnt, and ScraperAPI services. And it is open-source!

• UpdatedNov 29, 2024
• TypeScript

Apify actor to scrape Youtube search results. You can set the maximum videos to scrape per page as well as the date from which to start scraping.

• UpdatedSep 7, 2022
• JavaScript

You can use this act to monitor any page's content and get a notification when content changes.

• UpdatedJul 25, 2022
• JavaScript

Web application for recording, management and editing of inteligent RPA workflows using Playwright technology

• UpdatedSep 18, 2022
• TypeScript

No more dealing with Google API. Simple Node.js program to automate access to Google Sheets.

• UpdatedOct 6, 2022
• JavaScript

Apify actor for scraping events from Ticketmaster based on their categories

• UpdatedJan 10, 2023
• JavaScript

Automate monitoring prices on the most popular solution for building online stores and selling products online. Crawl arbitrary Shopify-powered online stores and extract a list of all products in a structured form, including product title, price, description, etc

• UpdatedJun 5, 2023
• JavaScript

CurlX a basic Curl syntax

• UpdatedJul 10, 2025
• PHP