cleaning-data

A framework for cleaning Chinese dialog data

An open-source package for python to clean raw text data

Time-series Data Preprocessing Studio in Jupyter notebook.

Implementation of the paper Identifying Mislabeled Data using the Area Under the Margin Ranking: https://arxiv.org/pdf/2001.10528v2.pdf

Simple and automatic data cleaning in one line of code! It performs one-hot encoding, date & time casting to datetime dtype, detects binary columns, safely convert non-numeric columns to numeric dtypes, cleaning dirty/empty values, normalizing values and removing unwanted columns all in one line of code. Get your data ready for model training and fitting quickly.

Data cleaning tool.

Some little notes from the author for everyone who wants to know or learn about the process that a data scientist must do from the beginning of data collection to making predictions with a model that has been built. These notes are based on the knowledge that the authors have learned and implemented. Enjoy it!

A fast framework for pre-processing (Cleaning text, Reduction of vocabulary, Feature extraction and Vectorization). Implemented with parallel processing using custom number of processes.

A simple tool for cleaning image datasets at a glance.

Udacity Data Analyst Nanodegree - Project IV

NodeJS wrapper for the email-validator.net API

Udacity Natural Language Processing Nanodegree.

We have all been in a situation where we go to a doctor in an emergency and find that the consultation fees are too high. As data scientists, we all should do better. What if you have data that records important details about a doctor and you get to build a model to predict the doctor’s consulting fee?

Practice Repository for Natural Language tasks!

Clean your data frame in one readable function

The main aim is to clean the data with pandas library.

Learn how much Singapore is saving energy per years by recycling plastics, paper, glass, ferrous and non-ferrous metal

A complete collection of commonly used code Snippets in Python

Introducing you to the fundamentals of the quintessential Python data analysis library, pandas, and its core data structures – the Series and DataFrame objects.

Data analysis and forecasting applied to World Happiness

The aim of this project is to find mobile app profiles that are profitable for the App Store and Google Play markets.

An analysis and exploration of 4 years of Trump's tweets, including data cleaning, sentiment analysis and topic categorization with LDA and NMF.

In this project, I will demonstrate my skill in cleaning data with R.

Project No. 4 in the Udacity Data Analyst Nanodegree Winter 2019-2020. Using Python, we’ll gather data from a variety of sources, assess its quality and tidiness, then clean it. We’ll document our wrangling efforts in a Jupyter Notebook, plus showcase them through analyses and visualizations using Python and SQL.

Interactive polynomial fit with a smooth union between original data and fit

This file contains advanced excel formulas and functions like Vlookup with match function, index and match function, offset & counta, logical operators, max if function, formula formatting, text functions, Date and time functions, data cleaning, etc. which I have worked on to take my excel skills at the high level.

Different types of Linear Regression using sklearn performed on KC House Data

Unsupervised Machine Learning- CyrptoCurrency Analysis, using several models on a cryptocurrency data in order to discover patterns and groups in data. Analysis done to create a report that includes what cryptocurrencies are on the trading market and how they could be grouped in order to create a classification system for potential new investments into the cryptocurrency market.

This exclusive repository consists of various minor data analysis projects and study materials to acquire the knowledge behind data visualization and programming with MATLAB. Diverse topics are covered from Crime against women, Sentiment Analysis, Digital Signal Analysis, Student Academic Performance Data to Analyzing Temperature and Humidity in Finland.