Dedupe.io

Repositories

dedupe

🆔 A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.

python dedupe record-linkage python-library forest entity-resolution datamade

Python MIT 398 2,708 39 1 Updated Jul 20, 2020

dedupe-variable-name

name variable type for dedupe

dedupe dedupe-variable

Python 4 5 1 1 Updated Jun 30, 2020

dedupe-variable-ilcs

Dedupe variable for Illinois Compiled Statute (ILCS) codes

Python MIT 0 0 2 0 Updated Jun 16, 2020

dedupeio-web-api-docs

Dedupe.io web API allows for matching and training against projects using a standard RESTful framework.

Python 2 3 1 0 Updated May 26, 2020

hcluster

Hierarchical Clustering Algorithms

python clustering hierarchical-clustering

Python 16 17 3 1 Updated May 14, 2020

pyhacrf

Forked from dirko/pyhacrf

📐 Hidden alignment conditional random field for classifying string pairs.

python nlp edit-distance string-distance conditional-random-fields

Python BSD-3-Clause 15 14 5 2 Updated May 9, 2020

dedupe-examples

🆔 Examples for using the dedupe library

python dedupe record-linkage entity-resolution

Python MIT 160 246 3 1 Updated May 6, 2020

rlr

Regularized Logistic Regression

python logistic-regression l2-regularization

Python 7 7 3 5 Updated Mar 31, 2020

dedupe-variable-number

Try to cast strings to numbers, then compare

Python 0 1 2 0 Updated Mar 31, 2020

parseratorvariable

Base class for dedupe variables for parsed fields

dedupe dedupe-variable

Python 2 1 2 0 Updated Mar 31, 2020

highered

CRF Edit Distance

python edit-distance string-distance conditional-random-fields

Python 3 4 3 0 Updated Mar 31, 2020

simplecosine

📐 simple cosine distance

python string-similarity

Python 3 1 1 0 Updated Mar 31, 2020

categorical-distance

📐 Compare categorical variables

Python 2 2 1 0 Updated Mar 31, 2020

datetime-distance

 📐 Compare dates and times

Python MIT 3 1 1 0 Updated Mar 31, 2020

fuzzycategory

📐 Fuzzy Categorical Distances

Python MIT 4 9 0 0 Updated Mar 31, 2020

dedupe-variable-employer

dedupe dedupe-variable

Python 1 3 1 0 Updated Mar 31, 2020

dedupe-variable-fuzzycategory

Dedupe Variable for Fuzzy Categories

dedupe dedupe-variable

Python 3 2 1 0 Updated Mar 31, 2020

dedupe-variable-address

Address Variable Type for dedupe

dedupe dedupe-variable

Python 3 5 6 0 Updated Mar 31, 2020

soft-tfidf

Mispelling tolerant tf-idf similarity metric

MIT 0 1 1 0 Updated Mar 31, 2020

learned-string-alignments

Forked from iesl/learned-string-alignments

Learning String Alignments for Entity Aliases

Python Apache-2.0 5 2 0 0 Updated Mar 31, 2020

dedupe-variable-datetime

DateTime variable for dedupe

Python 1 2 2 0 Updated Mar 31, 2020

dedupe-geocoder

📍 Demonstration of how dedupe might be used as geocoder

Python MIT 4 14 2 3 Updated Mar 31, 2020

dedupe-vowpal

Vowpal Wabbit Active Labeler for Dedupe

Python MIT 2 2 0 0 Updated Mar 31, 2020

dedupe-variable-person

Dedupe variable for person names. just people. no companies.

Python 2 6 1 0 Updated Mar 31, 2020

address-matching

Python script for matching a list of messy addresses against a gazetteer using dedupe.

Python 17 32 5 0 Updated Mar 31, 2020

pylbfgs

Forked from larsmans/pylbfgs

🚠 Python/Cython wrapper for liblbfgs

python optimization-algorithms bfgs quasi-newton owlqn

C MIT 30 14 2 1 Updated Mar 31, 2020

doublemetaphone

🔉 Python wrapper for a C++ Double Metaphone

python string-matching double-metaphone

C++ MIT 2 5 2 0 Updated Mar 31, 2020

affinegap

📐 A Cython implementation of the affine gap string distance

python cython levenshtein-distance string-distance

Python MIT 4 41 3 0 Updated Mar 31, 2020

csvdedupe

🆔 Command line tool for deduplicating CSV files

cli dedupe record-linkage csv-files entity-resolution

Python 69 291 18 3 Updated Mar 31, 2020

Levenshtein_search

Forked from mattandahalfew/Levenshtein_search

Python search module for fast approximate string matching

C MIT 10 3 0 0 Updated Aug 8, 2018