Build, test, deploy, iterate - Dev and prod tool for data science pipelines

Predict stock price based on financial news feeds

Apply for a job at Olist's Data Team: http://bit.ly/olist-bsa

Data engineering interviews Q&A for data community by data community

Forecasting Solar Power: Analysis of using a LSTM Neural Network

Contains basic things (Data structure, Algorithm, Cracking coding Interview Q&A...etc) for Data engineers.

kedro cli plugin for generating a static kedro viz site (html, css, js) that can be deployed on many serverless tools.

Quantum Black Hackathon organised by Analytics Vidya

Материалы для курса Введение в Data Engineering: дата пайплайны

This is a quick-and-dirty data analytics platform based on Spark, Hadoop and Jupyterhub. All this tools are deployed automatically with docker and docker-compose.

ML Toolkit

A GitHub Action to lint, test, build-docs, package, and run your kedro pipelines. Supports any Python version you'll give it (that is also supported by pyenv).

Extract logs based off events from sysmon. Comes as a package, cli and ui.

Compressing data using Python and compression techniques for better data storage and transfer.

Perfect for small data

Courses and projects on Data Camp

My Solutions to the practice tests provided at http://nn02.itversity.com/cca175/ by ITVersity.

Pipeline validation using Great Expectations library

This code is used to connect to fixer.io api, Download the currency exchange rates as keeping EUR as base currency. It also provides functions to download the historical data for any date and the average conversion date between 2 dates.

Crosslend DE Assignment

Simple default web application (university assignment)

US_Births_1994-2014

Github star counter

In the Project Workspace, I'll find a data set containing real messages that were sent during disaster events. I will be creating a machine learning pipeline to categorize these events so that you can send the messages to an appropriate disaster relief agency. This project will include a web app where an emergency worker can input a new message and get classification results in several categories. The web app will also display visualizations of the data. This project will show off my software skills, including your ability to create basic data pipelines and write clean, organized code.

Pypeline is a small library that help you process data (stream or batch) taking advantage of python multiprocessing library.

Data Engineering

Machine Learning Pipeline to categorize emergency messages based on the needs communicated by the sender.

12 project for my we chart doc in every month