data-curation

FastDup is a tool for gaining insights from a large image collection. It can find anomalies, duplicate and near duplicate images, clusters of similaritity, learn the normal behavior and temporal interactions between images. It can be used for smart subsampling of a higher quality dataset, outlier removal, novelty detection of new information to be sent for tagging. FastDup scales to millions of images running on CPU only.

Xtreme1 - The Next GEN Platform for Multisensory Training Data. #3D annotation, lidar-camera annotation and image annotation tools are supported!

Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.

Lesson guide and textbook for "Data as a Science" course.

Learn2Clean: Optimizing the Sequence of Tasks for Data Preparation and Cleaning

Curation of BIDS (CuBIDS): A sanity-preserving software package for processing BIDS datasets.

Curated list of known efforts in collecting and/or curating of chemical/materials data

tranSMART Arborist ETL toolkit

AqSolDB: A curated aqueous solubility dataset contains 9.982 unique compounds.

Data Cleaning and Data Profiling Library for Python

Codes I wrote for the paper : "Global determinants of freshwater and marine fish genetic diversity" Nature Communications, 2020

general purpose curation of exposure science data

Python tool using the Figshare API for data curation

Code for data linkage (curation of research database).

This is a task for Hamoye stage E Internship on Data curation, with focus on Amazon Book website.

TranSMART Arborist: Graphical tool for reshaping your data for the tranSMART data warehouse.

One of the biggest barriers to widespread machine learning adoption is the difficulty in collecting a 'good' dataset. There is an overall consensus that a 'good' dataset is a big dataset, but we believe that we can do better. As such the VennData project was created to develop tools to guide in the collection, curation, augmentation and validation of data.

Web Scraping & Text Data Collecting and Curating for Maithili Language. Also Language Modeling for collected data.

data filter routines using numpy