pii

Star

Here are 163 public repositories matching this topic...

Language:All

Filter by language

All163 Python57 Go24 JavaScript15 Java12 Jupyter Notebook9 C#8 Ruby6 TypeScript5 R3 Scala3

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

microsoft /presidio

Star4.3k

Context aware, pluggable and customizable data protection and de-identification SDK for text and images

microsoft python privacy transformers dlp data-protection privacy-protection anonymization pii data-anonymization data-loss-prevention de-identification data-masking data-scrubbing presidio text-anonymization pii-anonymization-service pii-detection anonymization-service pii-anonymization

UpdatedMar 18, 2025
Python

CatchTheTornado /text-extract-api

Star2.5k

Document (PDF, Word, PPTX ...) extraction and parse API using state of the art modern OCRs + Ollama supported models. Anonymize documents. Remove PII. Convert any document or picture to structured JSON or Markdown

api pdf json ocr extract anonymization pii ocr-python llm

UpdatedFeb 4, 2025
Python

capitalone /DataProfiler

Star1.5k

What's in your data? Extract schema, statistics and entities from datasets

python nlp security data-science machine-learning privacy csv avro tabular-data pandas dataset data-analysis graph-data gdpr npi sensitive-data pii network-data dataprofiling data-labels

UpdatedMar 18, 2025
Python

securitybunker /databunker

Star1.3k

Secure Vault for Customer PII/PHI/PCI/KYC Records

security privacy encryption database vault application-server compliance passportjs tokenization gdpr data-protection legaltech anonymization pii data-anonymization secure-storage privacy-by-design user-consent piidata ccpa

UpdatedMar 19, 2025
Go

redhuntlabs /Octopii

Star664

An AI-powered Personal Identifiable Information (PII) scanner.

python nlp machine-learning cloud ocr image-processing blackhat cybersecurity optical-character-recognition pii pii-detection

UpdatedJan 22, 2025
Python

tokern /piicatcher

Star304

Scan databases and data warehouses for PII data. Tag tables and columns in data catalogs like Amundsen and Datahub

python data database catalog snowflake data-catalog aws-athena aws-redshift phi pii aws-glue

UpdatedJan 5, 2024
Python

rohitcoder /hawk-eye

Sponsor

Star216

A powerful scanner to scan your Filesystem, S3, MySQL, Redis, Google Cloud Storage and Firebase storage for PII and sensitive data.

auditing scanner audit cybersecurity infosec grc pii secrets-management datasecurity

UpdatedMar 3, 2025
Python

microsoft /presidio-research

Star190

This package features data-science related tasks for developing new recognizers for Presidio. It is used for the evaluation of the entire system, as well as for evaluating specific PII recognizers or PII detection models.

nlp machine-learning natural-language-processing privacy deep-learning transformers spacy named-entity-recognition ner flair pii

UpdatedMar 3, 2025
Jupyter Notebook

samber /slog-formatter

Sponsor

Star162

🚨 slog: Attribute formatting

go golang middleware formatter formatting handler logger logging error structured-logging anonymization pii slog log-level

UpdatedFeb 10, 2025
Go

GoogleCloudPlatform /dlp-dataflow-deidentification

Star90

Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP

bigquery data beam dataflow tokenization dlp pii

UpdatedAug 13, 2024
Java

klouddb /klouddbshield

Star87

KloudDB Shield is a comprehensive Postgres Security Tool - PII Scanner , CIS Benchmarks , SSL audit , 12+ features .. Supports Postgres, RDS ,Aurora, MySQL

security postgres cis postgresql aurora pii cis-benchmark cis-benchmarks rds-mysql rds-postgres piiscanner

UpdatedDec 19, 2024
Go

EdyVision /pii-codex

Star84

A research python package for detecting, categorizing, and assessing the severity of personal identifiable information (PII)

python research analysis poetry python3 data-analysis research-tool pii research-software personal-identifiable-information presidio pii-detection

UpdatedJul 11, 2023
Python

amanvirparhar /elara

Star56

A simple tool to anonymize LLM prompts.

anonymization pii gliner

UpdatedJan 26, 2025
Svelte

polentino /redacted

Star49

Scala library and compiler plugin that prevent inadvertent leakage of sensitive fields in `case classes` (such as credentials, personal data, and other confidential information)

privacy scala scala3 gdpr pii privacy-tools scala-plugin scala3-plugin dotty-plugin

UpdatedMar 19, 2025
Scala

open-privacy /opv

Star49

Open Privacy Vault - Secure, Performant, Open Source PII as a Service.

security privacy pii

UpdatedMay 1, 2024
Go

deliciousinsights /mongoose-pii

Star45

A Mongoose plugin that lets you transparently cipher stored PII and use securely-hashed passwords

security mongodb mongoose password bcrypt mongoose-plugin passwords pii pii-ciphering

UpdatedJan 4, 2023
JavaScript

apicrafter /metacrafter

Star44

Metadata and data identification tool and Python library. Identifies PII, common identifiers, language specific identifiers. Fully customizable and flexible rules

metadata data-profiling pii entity-recognition pii-detection datadiscovery