data-extraction

Converts a pdf file into a text file while keeping the layout of the original pdf. Useful to extract the content from a table in a pdf file for instance. This is a subclass of PDFTextStripper class (from the Apache PDFBox library).

java pdf text layout extract pdfbox data-extraction

UpdatedDec 17, 2023
Java

hi-primus /optimus

Star1.5k

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

data-science machine-learning spark bigdata data-transformation pyspark data-extraction data-analysis data-wrangling dask data-exploration data-preparation data-cleaning data-profiling data-cleansing big-data-cleaning data-cleaner cudf dask-cudf

UpdatedDec 2, 2024
Python

shcherbak-ai /contextgem

Star1.5k

ContextGem: Effortless LLM extraction from documents

nlp ai text-analysis docx data-extraction contract-analysis legaltech docx2txt unstructured-data document-intelligence llm docx2md prompt-engineering llms generative-ai llm-framework llm-pipeline llm-extraction

UpdatedOct 1, 2025
Python

brightdata /brightdata-mcp

Star1.4k

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

mcp scraping web-scraping data-extraction data-collection structured-data web-crawling browser-automation ai-agents web-data scraping-tools anti-bot-detection llm ai-integrations mcp-server modelcontextprotocol

UpdatedSep 24, 2025
JavaScript

raznem /parsera

Star1.2k

Lightweight library for scraping web-sites with LLMs

python opensource ai scraping data-extraction webscraping playwright llm ai-scraping

UpdatedAug 25, 2025
Python

thinh-vu /vnstock

Sponsor

Star981

A beginner-friendly yet powerful Python toolkit for financial analysis and automation — built to make modern investing accessible to everyone

stock-market data-extraction quantitative-finance quantitative-trading quantitative-analysis stock-screener

UpdatedSep 17, 2025
Python

polyrabbit /hacker-news-digest

Star728

📰 Let ChatGPT Summarize Hacker News for You

python rss crawler machine-learning spider hacker-news news-aggregator openai hacker-news-reader data-extraction extract-summaries hacker-news-digest openai-api chatgpt chatgpt-api

UpdatedSep 12, 2025
Python

adrienjoly /npm-pdfreader

Star691

🚜 Parse text and tables from PDF files.

javascript parsing tabular-data pdf-converter data-extraction pdf-reader parse-tables rule-based-parsing

UpdatedJan 22, 2025
HTML

trustgraph-ai /trustgraph

Star661

The agentic AI platform for enterprise. Built for availability, scalability, and security. Complete end-to-end context engineering and LLM orchestration infrastructure. Run anywhere - local, cloud, or bare metal.

data context data-engineering data-extraction data-sovereignty model-serving etl-pipeline ai-native llm-deployment context-management graphrag llm-orchestration agentic-rag agentic-ai agentic-ai-development knowledge-core trustgraph agentic-graphrag context-engineering

UpdatedOct 6, 2025
Python

saifyxpro /HeadlessX

Star574

A lightweight, self-hosted headless browser automation platform. Designed as an alternative to Browserless, built for speed, privacy, and scalability.

automation headless web-scraping chromedriver data-extraction automation-api chrome-headless browser-automation headless-chrome browser-testing web-automation puppeteer browserless automation-platform playwright headless-service scraping-service playwright-automation container-automation

UpdatedSep 26, 2025
JavaScript

a-maliarov /amazoncaptcha

Star484

Pure Python, lightweight, Pillow-based solver for Amazon's text captcha.

amazon captcha pillow python3 data-extraction captcha-solver training-data amazon-scraper amazon-captcha amazoncaptcha

UpdatedOct 3, 2025
Python

eclaire-labs /eclaire

Star331

Local-first, open-source AI assistant for your data. Unify tasks, notes, docs, photos, and bookmarks. Private, self-hosted, and extensible via APIs.

open-source automation privacy ocr ai rest-api bookmarks self-hosted data-extraction note-taking web-archiving bookmark-manager task-management document-processing on-device-ai local-first personal-knowledge-management ai-assistant llm

UpdatedOct 6, 2025
TypeScript

py-pdf /benchmarks

Star312

Benchmarking PDF libraries

pdf benchmark text-extraction mupdf data-extraction pypdf2 poppler-utils

UpdatedJul 2, 2025
Python

jpjacobpadilla /Stealth-Requests

Star299

Undetected web-scraping & seamless HTML parsing in Python!

python data web-crawler http-client http-requests requests web-scraping xpath data-extraction html-parsing webscraping python-web-scraper python-scraping

UpdatedJul 14, 2025
Python

ScrapeGraphAI /scrapecraft

Sponsor

Star241

🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.

react python docker automation typescript ai web-scraping data-extraction webscraping hacktoberfest fastapi langgraph scrapegraphai