#

record-linkage

Here are 77 public repositories matching this topic...

openvenues / libpostal

A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.

c nlp machine-learning natural-language-processing record-linkage address address-parser international deduplication deduping

Updated May 6, 2022
C

dedupeio / dedupe

🆔 A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.

python clustering dedupe record-linkage python-library entity-resolution datamade dedupe-library de-duplicating

Updated May 8, 2022
Python

recordlinkage

J535D165 / recordlinkage

Sponsor

A powerful and modular toolkit for record linkage and duplicate detection in Python

python machine-learning privacy dedupe record-linkage python-library entity-resolution similarity string-distance deduplication data-matching utrecht-university

Updated Apr 19, 2022
Python

Yomguithereal / talisman

Sponsor

Straightforward fuzzy matching, information retrieval and NLP building blocks for JavaScript.

machine-learning natural-language-processing information-retrieval clustering record-linkage fuzzy-matching deduplication

Updated May 5, 2021
JavaScript

dedupeio / csvdedupe

🆔 Command line tool for deduplicating CSV files

cli dedupe record-linkage csv-files entity-resolution

Updated Mar 31, 2020
Python

dedupeio / dedupe-examples

🆔 Examples for using the dedupe library

python dedupe record-linkage entity-resolution

Updated Jan 19, 2022
Python

J535D165 / data-matching-software

Sponsor

A list of free data matching and record linkage software.

open-source machine-learning awesome record-linkage entity-resolution fuzzy-matching software awesome-list deduplication data-matching

Updated Apr 21, 2022

moj-analytical-services / splink

Implementation of Fellegi-Sunter's canonical model of record linkage in Apache Spark, including EM algorithm to estimate parameters

spark record-linkage entity-resolution fuzzy-matching deduplication em-algorithm data-matching deduplicate-data

Updated May 7, 2022
Roff

zouzias / spark-lucenerdd

Open

[Implicits] Support MapType for Spark DataFrames

zouzias commented Apr 21, 2019

Is your feature request related to a problem? Please describe.
Currently, MapType are not supported for Spark DataFrames

Describe the solution you'd like
Add support for MapType Spark DataFrame columns

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other co

Read more

enhancement good first issue

Open

Improve test coverage on Lucene Analyzers per field

Open

Store query that links the documents

3

Find more good first issues

dice-group / LIMES

Link Discovery Framework for Metric Spaces.

machine-learning linked-data rdf optimization record-linkage scalability semantic-web artificial-intelligence

Updated Mar 11, 2022
JavaScript

vintasoftware / entity-embed

PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolution using Approximate Nearest Neighbors.

python deep-learning record-linkage entity-resolution pytorch embeddings representation-learning deduplication entity-matching data-matching approximate-nearest-neighbors

Updated Apr 26, 2022
Jupyter Notebook

usc-isi-i2 / rltk

Record Linkage ToolKit (Find and link entities)

record-linkage entity-resolution similarity deduplication linkage similarity-metric string-similarity

Updated Dec 13, 2021
Python

Wikidata / soweego

Link Wikidata items to large catalogs

wikidata record-linkage wikimedia entity-resolution knowledge-graph identifiers entity-linking data-matching

Updated Dec 10, 2021
Python

ropeladder / record-linkage-resources

Resources for tackling record linkage / deduplication / data matching problems

javascript python java record-linkage entity-resolution deduplication data-matching

Updated Apr 12, 2021

data61 / anonlink

Python implementation of anonymous linkage using cryptographic linkage keys

cryptography record-linkage entity-resolution privacy-enhancing-technologies privacy-preserving

Updated May 4, 2022
Python

cleanzr / dblink

Distributed Bayesian Entity Resolution in Apache Spark

apache-spark record-linkage entity-resolution bayesian-inference mcmc distributed-machine-learning

Updated Jun 10, 2021
Scala

dssg / pgdedupe

A simple command line interface to the datamade/dedupe library.

python database dedupe record-linkage postgresql data-cleaning deduplication

Updated Nov 15, 2021
Jupyter Notebook

data61 / clkhash

CLK hash: hash pii for entity matching

hashing record-linkage privacy-enhancing-technologies entity-matching privacy-preserving-record-linkage

Updated May 4, 2022
Python

Senzing / awesome

Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.

resolution awesome resource record-linkage entity-resolution entity entity-matching senzing t-comm

Updated Apr 10, 2022
Python

entrepreneur-interet-general / Merge-Machine

Merge Dirty Data with Clean Reference Tables

python elasticsearch record-linkage entity-resolution entrepreneur-interet-general

Updated Aug 3, 2021
Python

iesl / stance

Learned string similarity for entity names using optimal transport.

record-linkage entity-resolution aliases string-distance string-matching optimal-transport string-similarity stance

Updated Nov 17, 2020
Python

J535D165 / recordlinkage-annotator

Sponsor

A browser user interface for manual labeling of record pairs.

machine-learning record-linkage entity-resolution deduplication annotation-tool labeling-tool data-matching

Updated Apr 29, 2022
JavaScript

k3jph / phonics-in-r

Phonetic Spelling Algorithms in R

record-linkage linguistics text-processing soundex nysiis metaphone phonetic-spelling-algorithms phonics bsd-2-license

Updated Sep 25, 2021
R

J535D165 / FEBRL-fork-v0.4.2

Sponsor

Fork of the Freely Extensible Biomedical Record Linkage program

matching record-linkage python-library entity-resolution deduplication

Updated Nov 4, 2016
Python

data61 / anonlink-entity-service

Privacy Preserving Record Linkage Service

record-linkage privacy-enhancing-technologies privacy-preserving-record-linkage

Updated May 2, 2022
Python

vaneseltine / nominally

A maximum-strength name parser for record linkage.

parser data-science parsing record-linkage entity-resolution deduplication data-matching human-name

Updated Oct 19, 2021
Python

zouzias / spark-lucenerdd-examples

Examples of spark-lucenerdd

docker spark examples record-linkage lucene lucene-query entity-linking

Updated Jun 2, 2021
Scala

cleanzr / fasthash

Performs unique entity estimation corresponding to Chen, Shrivastava, Steorts (2018).

hashing record-linkage entity-resolution blocking entity-estimation

Updated Feb 21, 2019
Python

ngmarchant / oasis

A Python package for efficient evaluation based on OASIS (Optimal Asymptotic Sequential Importance Sampling).

record-linkage entity-resolution classification evaluation-method sampling-schemes

Updated Jun 4, 2021
Python

data61 / blocklib

Python implementations of record linkage blocking techniques.

record-linkage privacy-enhancing-technologies privacy-preserving-record-linkage

Updated May 2, 2022
Python

Improve this page

Add a description, image, and links to the record-linkage topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the record-linkage topic, visit your repo's landing page and select "manage topics."