Multi functional app to find duplicates, empty folders, similar images etc.

Copy/paste detector for programming source code.

Extremely fast tool to remove duplicates and other lint from your filesystem

Deduplication tool for yarn.lock files

Interesting (non-cryptographic) hashes implemented in pure Python.

Quickly detect already witnessed data.

Loads async data for Redux apps focusing on preventing duplicated requests and dealing with async dependencies.

Plugin for Mongoose that turns duplicate errors into regular Mongoose validation errors

Vidupe is a program that can find duplicate and similar video files. V1.211 released on 2019-09-18, Windows exe here:

CLI utility to find duplicate files

Nextcloud Media Duplicate Collector application

A simple tool for detecting near-duplicate source code

A deduplicator

Advanced Duplicate File Finder for Python

Remove Duplicate Messages

Advanced similarity and duplicate source code at scale.

Advanced similarity and duplicate source code proof of concept for our research efforts.

Tool for removing duplicate documents from Elasticsearch

Command-line program for managing a media collection, with focus on Content-Based Image Retrieval (Computer Vision) methods for finding duplicates.

JS script that allows you to remove duplicates from your Last.fm scrobbles library.