duplicate-detection
Here are 359 public repositories matching this topic...
Language:All
Sort:Most stars
Interact, analyze and structure massive text, image, embedding, audio and video datasets
- Updated
Jun 13, 2025 - Python
WinDirStat is a disk usage statistics viewer and cleanup tool for Microsoft Windows
- Updated
Jul 15, 2025 - C++
Remove duplicates from MASSIVE wordlist, without sorting it (for dictionary-based password cracking)
- Updated
May 16, 2025 - C++
A plugin that does one thing only: Detect and manage duplicate items in Zotero.
- Updated
Mar 24, 2025 - TypeScript
Filter, Sort & Delete Duplicate Files Recursively
- Updated
Jul 18, 2025 - Rust
Near Duplicate Video Detection (Perceptual Video Hashing) - Get a 64-bit comparable hash-value for any video.
- Updated
Jul 12, 2024 - Python
⚡ Check your npm modules for unused and duplicate dependencies fast
- Updated
May 27, 2022 - Go
An extension toolkit for Immich enabling advanced management capabilities through AI-powered similarity detection
- Updated
Jul 16, 2025 - Python
The Panako acoustic fingerprinting system.
- Updated
May 31, 2024 - Java
Interactive code for image similarity using SIFT algorithm
- Updated
May 20, 2023 - Python
Vidupe is a program that can find duplicate and similar video files. V1.211 released on 2019-09-18, Windows exe here:
- Updated
Sep 27, 2019 - C++
CLI utility to find near duplicate images and remove all but the best copy.
- Updated
Jul 1, 2025 - Python
Fast Near-Duplicate Image Search and Delete using pHash, t-SNE and KDTree.
- Updated
Nov 22, 2022 - Python
Duplicates Detector is a cross-platform GUI utility for finding duplicate files, allowing you to delete or link them to save space. Duplicate files are displayed and processed on two synchronized panels for efficient and convenient operation.
- Updated
Jun 22, 2025 - Python
Easily delete your YouTube Music library (and manage playlists)
- Updated
Jul 5, 2025 - Python
Find similar audio files easily
- Updated
Nov 19, 2024 - Python
Command-line program for Content-Based Image Retrieval of images and videos. Includes tools for general search and de-duplication.
- Updated
Jul 8, 2025 - C++
A collection of free-text bug reports for duplicate issue identification
- Updated
Mar 18, 2024
CLI tool that fast checks if your bundle contains multiple versions of the same package, only by looking in package.json.
- Updated
Jul 16, 2020 - JavaScript
Duplicates finder for various source code formats.
- Updated
Jun 2, 2025 - C++
Improve this page
Add a description, image, and links to theduplicate-detection topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with theduplicate-detection topic, visit your repo's landing page and select "manage topics."