A fast file deduplicator
-
Updated
Oct 10, 2025 - Rust
#
file-deduplication
Here are 17 public repositories matching this topic...
Sort: Most stars
Sort options
Yet Another Dupes Finder
-
Updated
Sep 2, 2025 - Rust
.NET 8 API for document file format identification, text/metadata/attachment/embedded object/sensitive item (PII/PHI)/entity extraction.
metadata sdk csharp dotnet email text extraction indexing text-extraction archive pst embedded-objects file-format-detection entity-extraction phi file-deduplication pii microsoft-office pii-detection file-identification
-
Updated
Dec 31, 2024 - C#
Smash through to find duplicate files super fast by slicing files intelligently!
go windows macos linux cli freebsd duplicate-files deduplication cli-tool file-deduplication file-deduplication-tool
-
Updated
Oct 17, 2025 - Go
Case study using dotfurther's Open Discover Platform with the RavenDB document store to rapidly create a full-text search/eDiscovery/information governance capable demonstration application.
metadata text-extraction full-text full-text-search ravendb ediscovery indexing-engine file-format-detection data-breach file-deduplication pii information-governance-catalog personally-identifiable-information archive-extractor pii-detection file-identification full-text-extraction document-ingestion information-governance
-
Updated
May 28, 2024
fast duplicate file detection
fast command-line file-deduplication statically-linked duplicate-file-finder duplicate-file-detection
-
Updated
Oct 19, 2025 - C
File deduplicator
-
Updated
Apr 27, 2022 - Rust
Duplicate file finder and de-duplicator. A tool that detects duplicate files and replaces them with symlinks to a shared file in a special shared files folder.
-
Updated
May 12, 2025 - C#
Golang Deduplication Utility Library
-
Updated
Dec 29, 2017 - Go
Этот проект представляет собой мощный инструмент для поиска и анализа дублирующихся файлов в указанной директории. Программа позволяет эффективно выявлять одинаковые файлы на основе их содержимого, используя алгоритм хеширования SHA-256. Она поддерживает настройку параметров, таких как минимальный размер файла для проверки и игнорирование определен
python hashing productivity multithreading data-deduplication file-system sha256 file-management system-utility cli-tool dev-tools file-deduplication file-comparison disk-cleanup command-line-utility duplicate-file-finder
-
Updated
Feb 14, 2025 - Python
A simple command line utility that identifies groups of identical files and displays them to the console.
-
Updated
Mar 5, 2025 - Rust
CloneZapper is a Python script that hunts down identical files within a directory and its subdirectories, ruthlessly eliminating them!
-
Updated
Jun 1, 2024 - Python
Dedupy: a file deduplication tool
-
Updated
Mar 17, 2025 - Python
Find duplicate files in multiple folder(s) scanning .txt or/and .torrent files and depending on the selected mode (readonly: true | false) get information about duplicated files /+ extract them into new folders
nodejs cli typescript functional-programming file-scanner inquirer fp-ts file-deduplication eslint-plugin-functional inquirer-fuzzy-path
-
Updated
Oct 24, 2025 - TypeScript
Improve this page
Add a description, image, and links to the file-deduplication topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the file-deduplication topic, visit your repo's landing page and select "manage topics."