yennj12 yennanliu

Pinned

1. NYC_Taxi_Trip_Duration

   Develop models predict taxi trip duration in NYC. Ranked : Top 6% | RMSLE : 0.377 (Kaggle)

   Jupyter Notebook 3 2

2. analysis

   Repo for practical data science problems approaches, including notebook demo and working scripts

   Jupyter Notebook 5 3

3. data_science_repo

   Resources for data science/engineering learning (tutorial / book / docker). 1) data dev env setup 2) essential data ref 3) practical demo

   Shell 5 1

4. spark_emr_dev

   Collection of code for submitting Spark/Hadoop/Hive/Pig tasks to EMR (AWS Elastic MapReduce)

   Scala 1

5. XJob

   Run various ETL jobs via Airflow (Airflow as job dispense center) : 1) env set up 2) airflow DAG 3) Spark/ML/DL script

   Python 4

6. data_infra_repo

   Collections of data infrastructure development 1) Celery Job threads 2) DB maser- slave config 3) kafka-redis event fetch 4) Superset BI tool build

   Java 2