dagster

An orchestration platform for the development, production, and observation of data assets.

New Generation Opensource Data Stack Demo

Real estate dagster pipeline

Template Dagster repo using poetry and a single Docker container; works well with CICD

dagster scikit-learn pipeline example.

MLOps template with examples for Data pipelines, ML workflow management, API development and Monitoring.

An example of a Dagster project with a possible folder structure to organize the assets, jobs, repositories, schedules, and ops. Also has examples of unit-tests and docker deployment with a Postgresql database.

A curated list of dagster code snippets for data engineers

The easier way to do machine learning in Python without coding!

End to end data engineering project

A terraform module that deploys Dagster to AWS, using ECS.

Get introduced to Directed Acyclic Graphs (DAGs) through Dagster with a simple ML program

Data science, data engineering and machine learning experiments, PoCs and code snippets

A simple Data Engineering solution for testing or education purposes. You only need to know SQL and Python to understand this project. Dagster is the data orchestration, while DBT is for data transformation. The BI tool is Metabase.

Introduction to dagster including a demonstration of software defined assets

Package for integrating Hashicorp Vault with Dagster.

Work in progress effort, featuring data engineering/analytics workflows developed with open source tools ✨

Dagster resource for Azure Key Vault

This is a boilerplate repo for setting up your scalable dagster deployment using docker and ansible