Movatterモバイル変換

Skip to content

#

data-extraction

Here are 1,200 public repositories matching this topic...

Language:All

Filter by language

All1,200 Python583 Jupyter Notebook167 JavaScript77 TypeScript38 HTML34 Java24 Go16 C#15 R11 PHP9

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

firecrawl

firecrawl /firecrawl

🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data

markdown crawler scraper ai html-to-markdown web-crawler scraping web-scraper web-scraping data-extraction webscraping web-data-extraction ai-agents web-search ai-search web-data llm ai-crawler ai-scraping

UpdatedNov 29, 2025
TypeScript

ScrapeGraphAI /Scrapegraph-ai

Python scraper based on AI

markdown crawler web-crawler scraping web-scraper web-scraping data-extraction webscraping web-data-extraction web-search ai-search rag automated-scraper web-data scraping-python web-crawlers llm ai-crawler large-language-model ai-scraping

UpdatedNov 26, 2025
Python

getmaxun /maxun

Turn any website into clean, contextualized data pipelines for your workflows

api scraper automation browser web-scraper self-hosted web-scraping data-extraction webscraping agents hacktoberfest browser-automation no-code web-automation rpa robotic-process-automation nocode playwright hacktoberfest-accepted no-code-web-scraper

UpdatedNov 29, 2025
TypeScript

Scrapling

D4Vinci /Scrapling

🕷️ An undetectable, powerful, flexible, high-performance Python library to make Web Scraping Easy and Effortless as it should be!

python crawler data automation ai mcp scraping crawling web-scraper web-scraping selectors xpath data-extraction stealth webscraping crawling-python playwright web-scraping-python ai-scraping mcp-server

UpdatedNov 26, 2025
Python

vi3k6i5 /flashtext

Extract Keywords from sentence or Replace keywords in sentences.

nlp word2vec search-in-text data-extraction keyword-extraction

UpdatedApr 13, 2025
Python

hhursev /recipe-scrapers

Python package for scraping recipes data

python food library schema-org json-ld microdata data-extraction opengraph html-parsing meal recipe-scraper recipe-schema recipe-parser recipe-extraction

UpdatedNov 26, 2025
Python

contextgem

shcherbak-ai /contextgem

ContextGem: Effortless LLM extraction from documents

nlp ai text-analysis docx data-extraction contract-analysis legaltech docx2txt unstructured-data document-intelligence llm docx2md prompt-engineering llms generative-ai llm-framework llm-pipeline llm-extraction

UpdatedNov 16, 2025
Python

brightdata /brightdata-mcp

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

mcp scraping web-scraping data-extraction data-collection structured-data web-crawling browser-automation ai-agents web-data scraping-tools anti-bot-detection llm ai-integrations mcp-server modelcontextprotocol

UpdatedNov 24, 2025
JavaScript

JonathanLink /PDFLayoutTextStripper

Converts a pdf file into a text file while keeping the layout of the original pdf. Useful to extract the content from a table in a pdf file for instance. This is a subclass of PDFTextStripper class (from the Apache PDFBox library).

java pdf text layout extract pdfbox data-extraction

UpdatedDec 17, 2023
Java

hi-primus /optimus

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

data-science machine-learning spark bigdata data-transformation pyspark data-extraction data-analysis data-wrangling dask data-exploration data-preparation data-cleaning data-profiling data-cleansing big-data-cleaning data-cleaner cudf dask-cudf

UpdatedDec 2, 2024
Python

saifyxpro /HeadlessX

A lightweight, self-hosted headless browser automation platform. Designed as an alternative to Browserless, built for speed, privacy, and scalability.

automation headless web-scraping chromedriver data-extraction automation-api chrome-headless browser-automation headless-chrome browser-testing web-automation puppeteer browserless automation-platform playwright headless-service scraping-service playwright-automation container-automation

UpdatedOct 19, 2025
JavaScript

raznem /parsera

Lightweight library for scraping web-sites with LLMs

python opensource ai scraping data-extraction webscraping playwright llm ai-scraping

UpdatedOct 15, 2025
Python

vnstock

thinh-vu /vnstock

A beginner-friendly yet powerful Python toolkit for financial analysis and automation — built to make modern investing accessible to everyone

stock-market data-extraction quantitative-finance quantitative-trading quantitative-analysis stock-screener

UpdatedNov 14, 2025
Python

hacker-news-digest

polyrabbit /hacker-news-digest

📰 Let ChatGPT Summarize Hacker News for You

python rss crawler machine-learning spider hacker-news news-aggregator openai hacker-news-reader data-extraction extract-summaries hacker-news-digest openai-api chatgpt chatgpt-api

UpdatedSep 12, 2025
Python

adrienjoly /npm-pdfreader

🚜 Parse text and tables from PDF files.

javascript parsing tabular-data pdf-converter data-extraction pdf-reader parse-tables rule-based-parsing

UpdatedNov 21, 2025
HTML

eclaire-labs /eclaire

Local-first, open-source AI assistant for your data. Unify tasks, notes, docs, photos, and bookmarks. Private, self-hosted, and extensible via APIs.

open-source automation privacy ocr ai rest-api bookmarks self-hosted data-extraction note-taking web-archiving bookmark-manager task-management document-processing on-device-ai local-first personal-knowledge-management ai-assistant llm

UpdatedNov 13, 2025
TypeScript

ScrapeGraphAI /scrapecraft

🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.

react python docker automation typescript ai web-scraping data-extraction webscraping hacktoberfest fastapi langgraph scrapegraphai

UpdatedOct 26, 2025
Python

a-maliarov /amazoncaptcha

Pure Python, lightweight, Pillow-based solver for Amazon's text captcha.

amazon captcha pillow python3 data-extraction captcha-solver training-data amazon-scraper amazon-captcha amazoncaptcha

UpdatedOct 27, 2025
Python

py-pdf /benchmarks

Benchmarking PDF libraries

pdf benchmark text-extraction mupdf data-extraction pypdf2 poppler-utils

UpdatedJul 2, 2025
Python

jpjacobpadilla /Stealth-Requests

Undetected web-scraping & seamless HTML parsing in Python!

python data web-crawler http-client http-requests requests web-scraping xpath data-extraction html-parsing webscraping python-web-scraper python-scraping

UpdatedJul 14, 2025
Python

Improve this page

Add a description, image, and links to thedata-extraction topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with thedata-extraction topic, visit your repo's landing page and select "manage topics."

[8]ページ先頭

©2009-2025 Movatter.jp