website-scraper
Here are 121 public repositories matching this topic...
Language:All
Sort:Most stars
Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
- Updated
Sep 29, 2025 - Go
Download website to local directory (including all css, images, js, etc.)
- Updated
Nov 5, 2025 - JavaScript
Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface and deep web sources. Empower your data mining and analysis with Vanta's advanced capabilities. Fast, reliable, and user-friendly, Uscrapper Vanta is the ultimate choice for researchers and analysts.
- Updated
Nov 24, 2024 - Python
🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON.
- Updated
Apr 5, 2024 - TypeScript
Plugin for website-scraper which returns html for dynamic websites using puppeteer
- Updated
Oct 31, 2025 - JavaScript
CMS, WebSite, Application and Ecommerce Development Tool Using JavaScript
- Updated
Apr 30, 2025 - C#
DPULSE - Tool for complex approach to domain OSINT
- Updated
Oct 26, 2025 - Python
🕸 Generates RSS feeds of any website & serves to the web! Automatic scraping. Ready to use configs. Write your own. Rolling Docker releases for speedy updates.
- Updated
Nov 3, 2025 - Ruby
Wayback Machine Downloader. 🔥 Download your entire archived websites from the Internet Archive Wayback Machine.
- Updated
Aug 5, 2022 - C#
Automatically curates and posts content to LinkedIn. It can optionally use web scraping to gather data, which is then fed to ChatGPT to craft engaging LinkedIn posts.
- Updated
Apr 13, 2025 - Python
🚀从聊天记录创造数字分身的一站式解决方案💡 使用聊天记录微调大语言模型，让大模型有“那味儿”，并绑定到聊天机器人，实现自己的数字分身。 数字克隆/数字分身/数字永生/LLM/聊天机器人/LoRA
- Updated
Nov 6, 2025 - Python
ScrapeGPT is a RAG-based Telegram bot designed to scrape and analyze websites, then answer questions based on the scraped content. The bot utilizes Retrieval Augmented Generation and webscraping to return natural language answers to the user's queries.
- Updated
Feb 17, 2024 - Python
🌱 goClone - clone websites in seconds
- Updated
Oct 8, 2025 - Go
A server to collect & archive websites that also supports video downloads
- Updated
Feb 11, 2023 - TypeScript
Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blocking.
- Updated
Sep 19, 2025 - Python
Plugin for website-scraper which returns html for dynamic websites using PhantomJS.
- Updated
Dec 29, 2021 - JavaScript
Scraper forhttps://marvelsnapzone.com to retrieve metadata of Marvel SNAP cards.
- Updated
Jul 1, 2024 - Python
Evaluate JavaScript on a URL through headless Chrome browser.
- Updated
Jun 18, 2021 - JavaScript
JSON collection of scraped file extensions, along with their description and type, from FileInfo.com
- Updated
Nov 9, 2022 - Python
Now you can keep track of your followers from YouTube, Instagram and Twitter accounts - Followers scraper API on AWS serverless
- Updated
Jan 23, 2023 - TypeScript
Improve this page
Add a description, image, and links to thewebsite-scraper topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with thewebsite-scraper topic, visit your repo's landing page and select "manage topics."