Topic: duplicates

kucherenko / jscpd

1k

Copy/paste detector for programming source code.

detector quality copy-paste duplicates cpd code-quality

TypeScript Updated Mar 20, 2019

sahib / rmlint

652

Extremely fast tool to remove duplicates and other lint from your filesystem

c python filesystem lint duplicates

C Updated Feb 19, 2019

atlassian / yarn-deduplicate

202

Deduplication tool for yarn.lock files

yarn duplicates dedupe duplicated-packages yarn-lock lock-file

JavaScript Updated Feb 26, 2019

sean-public / python-hashes

191

Interesting (non-cryptographic) hashes implemented in pure Python.

python python3 hash hash-functions hashes-implemented bloom-filter nilsimsa geohashes simhash duplicates

Python Updated Mar 8, 2018

F483 / dejavu

145

Quickly detect already witnessed data.

golang go history memory deduplication duplicate-values duplicates command-line command-line-tool probabilistic

Go Updated Jul 16, 2017

kouhin / redux-dataloader

134

Loads async data for Redux apps focusing on preventing duplicated requests and dealing with async dependencies.

redux react thunk async action duplicates

JavaScript Updated Nov 14, 2017

matteodelabre / mongoose-beautiful-unique-validation

97

Plugin for Mongoose that turns duplicate errors into regular Mongoose validation errors

mongoose duplicates schema errors validation plugin

JavaScript Updated Jan 18, 2019

jvirkki / dupd

51

CLI utility to find duplicate files

duplicates duplicatefilefinder c duplicate-files deduplication

C Updated Nov 15, 2018 1 issue needs help

src-d / apollo

35

Advanced similarity and duplicate source code proof of concept for our research efforts.

Python Updated Jan 25, 2019

Bartozzz / potential-duplicates-bot

28

A configurable GitHub App which checks for potential issue duplicates using Damerau–Levenshtein distance algorithm.

github probot probot-app probot-plugin issues duplicates bot

JavaScript Updated Jun 15, 2018

deric / es-dedupe

27

Tool for removing duplicate documents from Elasticsearch

elasticsearch duplicates duplicity

Python Updated May 5, 2018

src-d / gemini

25

Advanced similarity and duplicate source code at scale.

duplicate-detection spark duplicates hash source-code-analysis

Scala Updated Feb 28, 2019

guicamest / GDuplicate-Finder

19

GDuplicate Finder - A Groovy way to find duplicates among your computer and network shares!

duplicate duplicates finder s3 network-share ssh gpars groovy

Groovy Updated Jul 12, 2018

caluml / finddups

18

Find duplicate files on your computer

java duplicate-files duplicates command-line command-line-tool simple

Java Updated Apr 4, 2017

mkearney / funique

16

⌚️ A faster unique() function

r rstats unique duplicates r-package mkearney-r-package data-wrangling data-frame date-time posixct posix

R Updated Dec 28, 2018

rustomax / ndf

15

Duplicate file finder written in nim

duplicate-files ndf nim duplicates duplicate-detection filesystem utility

Nim Updated Aug 1, 2018

nil0x42 / duplicut

15

Remove duplicates from huge wordlists without changing the order

C Updated Feb 18, 2019

rmdm / nodups

14

No dups, no doubts

unique uniq duplicates nodups

JavaScript Updated Nov 7, 2017

lmammino / indexed-string-variation

12

Experimental JavaScript module to generate all possible variations of strings over an alphabet using an n-ary virtual…

alphabet tree algorithm virtual characters nodejs node library variations duplicates strings string javascript javascript-library

JavaScript Updated Jan 4, 2018

vladsmirnov / url-rewrites

12

Magento 1.x module to target the URL Rewrite issue

magento duplicates modman composer reindex

PHP Updated Nov 30, 2017

deplicate / deplicate

10

Advanced Duplicate File Finder for Python

duplicate-files duplicatefilefinder duplicate-detection duplicates duplicate duplicates-removed scanning finder pypi python purge-duplicate-files multi-filtering unix windows macosx deplicate duplication-finder

Python Updated Apr 26, 2018

Microsoft / near-duplicate-code-detector

9

A simple tool for detecting near-duplicate source code

duplicates detect-duplicates

C# Updated Nov 19, 2018

danielpclark / dfm

8

Duplicate File Manager

duplicates file-indexing md5 recursively-search

Ruby Updated Jan 25, 2017

zx8754 / StackOverflowNotes

8

SO [r] tag list of dupes, help, links, etc.

stackoverflow questions-and-answers duplicates target r

Updated Jan 17, 2019

redonkulus / dump-deps

8

Dump NPM package dependencies to display packages with multiple versions.

npm deps dump-deps duplicates

JavaScript Updated Mar 18, 2019

NicolasBizzozzero / dupe_eraser

7

A command-line tool which automate the deletion of duplicate files.

duplicates cli file-management duplicate-files duplicate-detection

Python Updated Mar 31, 2018

CedricReichenbach / audiomerge

6

Merge multiple scattered music collections into one, taking only the best version of duplicates

audio duplicates

Java Updated Apr 9, 2017

DeaDSouL / dugu

6

Find, remove and avoid duplicates with dugu: The Duplicates Guru

python duplicate-detection duplicates duplicatefilefinder duplicate-files dugu duplicates-guru deduplication

Python Updated May 16, 2016

PokestarFan / DuplicateBot

4

Bot for duplicates

duplicates bot python reddit

Python Updated May 14, 2018

raspi / duplikaatti

4

Remove duplicate files.

go golang duplicate-files duplicates files

Go Updated Sep 10, 2018

Please note that GitHub no longer supports Internet Explorer.

duplicates

Repositories 93