StarRocks is a next-gen sub-second MPP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics and ad-hoc query.

Personal Data Engineering Projects

Udacity Data Engineering Nano Degree (DEND)

A framework for rapid reporting API development; with out of the box support for high cardinality dimension lookups with druid.

Python scripts to set up a multidimensional model and run an ETL process for Ethereum data analysis.

Create Data Lake on AWS S3 to store dimensional tables after processing data using Spark on AWS EMR cluster

Udacity Data Engineer Nanodegree - Postgres data modeling

A project to design a fact and dimension star schema for optimizing queries on a flight booking database using PostgreSQL, a relational database management system. This schema is well-suited for a flight booking database, as it allows for efficient querying of data such as booking dates, flight routes, and passenger information.

Data Warehousing (DW) Project Building and Analysing a DW for NatureFresh Stores in NZ, built using a high-performance Oracle database 12c, and Index-Nested Loops Join-Oracle.

Data Engineering Projects including Data Modeling, Data Warehouse, Data Lake Development

Data Warehouse - The Ultimate Guide coursework and learnings

A simplified introdocutory data analysis report to show how using SQL queries can answer questions from a data warehouse with a star schema. The report answers why server downtime happens and how it can be fixed.

This is a flask application that converts an informational model of a decision problem to a snow-flaked star schema

The main goal of this project is building up a data warehouse as a single-source-of-truth database by integrating data from different data sources for data analytics purpose and future backend usage.

This repository is my final project for the Data Engineering Nanodegree Program.

YAML format for star schema and snowflake schema

This repository is about designing a database model for Global Super Store. This project is the final project of the 7th course "Advanced Data Modeling" of Meta Database Engineer Professional Certificate on Coursera.

Udacity Data Engineer Nanodegree - Data Modelling with Postgresql