Fast Near-Duplicate Image Search and Delete using pHash, t-SNE and KDTree.

• UpdatedNov 22, 2022
• Python

Advanced Duplicate File Finder for Python

• UpdatedNov 23, 2020
• Python

Generate an object for testing if a request is sent, request is Mikeal's request.

• UpdatedOct 15, 2020
• JavaScript

🍰 A library for creating n-grams, skip-grams, bag of words, bag of n-grams, bag of skip-grams.

• UpdatedMar 8, 2022
• Java

Command line utility to remove exact duplicate files.

• UpdatedNov 24, 2018
• C++

File duplicate remover for Synology DSM 213j+

• UpdatedJun 15, 2018
• Java

Program to scan and search for file duplicates. (~300MB/s)

• UpdatedOct 21, 2022
• Java

Function that removes duplicate items and objects based on a key from an array of objects.

• UpdatedJul 17, 2017
• JavaScript

Command Line Interface for deplicate

• UpdatedSep 3, 2017
• Python

Takes an input CSV and produces a CSV of duplicate records. Then the input CSV is cleansed to remove duplicates.

• UpdatedJul 31, 2018
• Python

Sort, uniq, reverse, and randomize data

• UpdatedJul 8, 2020
• JavaScript

A no-nonsense .NET Core 2.1 CLI duplicate files remover

• UpdatedApr 4, 2021
• C#

rm-dup is a script to remove duplicate files

• UpdatedJan 2, 2019
• Shell

find and delete duplicate files

• UpdatedNov 23, 2019
• Go

powerful data preprocessing application that simplifies the task of preparing data for machine learning models.

• UpdatedJun 14, 2023
• Python

A tool that deduplicates lines of a textfile with the speed of ram and scales nicely on all cores concurrently.

• UpdatedApr 11, 2018
• Go

Searches for duplicates in two separate folders allowing removing duplicated files from one and keeping another intact.

• UpdatedMar 19, 2020
• Python

Finds and removes duplicate files

• UpdatedOct 31, 2022
• C#

Conducting EDA on Instacart orders

• UpdatedMay 14, 2023
• HTML

Created modified Levenshtein distance algorithms, to match strings by deletion and capitalization only and does not allow replacement or insertion of characters

• UpdatedApr 4, 2019
• Java