⚡  Web  ✍  Blog  ☕  Coffee

I'm a data engineer and scientist specializing in natural language processing. On Github I'm the author and maintainer of projects like Trafilatura, a popular open-source package to gather and extract text data used by researchers and the AI industry.

• Extracting the main text content from web pages using Python
• A simple multilingual lemmatizer for Python
• A module to extract date information from web pages
• Web scraping with R: Text and metadata extraction

Skills	Programming languages

PinnedLoading

1. trafilaturatrafilaturaPublic

   Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

   Python 4.1k 287

2. htmldatehtmldatePublic

   Fast and robust date extraction from web pages, with Python or on the command-line

   Python 124 26

3. simplemmasimplemmaPublic

   Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

   Python 154 12

4. rust-primesrust-primesPublic

   Rust code and command-line utility to compute and visualize prime sequences

   Rust

5. courlancourlanPublic

   Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters

   Python 135 9

6. German-NLPGerman-NLPPublic

   Curated list of open-access/open-source/off-the-shelf resources and tools developed with a particular focus on German

   468 66