Dynamically generate Apache Airflow DAGs from YAML configuration files
-
Updated
Feb 8, 2022 - Python
#
dags
Here are 24 public repositories matching this topic...
lilymedina
commented
Aug 16, 2019
While doing this check whether functions have become obsolete and deprecate accordingly.
Use regression, inverse probability weighting, and matching to close confounding backdoors and find causation in observational data
-
Updated
Feb 27, 2020
Udacity Data Engineering Nanodegree Capstone Project
airflow
udacity
jupyter-notebook
pandas
pyspark
psycopg2
udacity-nanodegree
dags
udacity-data-engineer-nanodegree
udacity-capstone
-
Updated
Mar 28, 2020 - Jupyter Notebook
The dag-checks consist of checks that can help you in maintaining your Apache Airflow instance.
-
Updated
Jan 25, 2021 - Python
-
Updated
Jan 22, 2022 - JavaScript
-
Updated
Mar 27, 2021 - TypeScript
Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse
-
Updated
Mar 11, 2022 - Python
Code to draw DAG figures for Mendelian randomization studies
-
Updated
Mar 18, 2022 - RMarkdown
A series of DAGs/Workflows to help maintain the operation of Airflow
-
Updated
Oct 2, 2019 - Python
Directed Graphical Models and Causal Discovery for Zero-Inflated Data.
-
Updated
Jan 13, 2021 - R
data pipeline to perform etl operations using apache-airflow to manage, schedule and author tasks
-
Updated
May 12, 2020 - Python
Apache Airflow exercises 🚀 https://www.udemy.com/course/the-complete-hands-on-course-to-master-apache-airflow/
-
Updated
Sep 13, 2021 - Python
Your extensible development environment for data projects with Apache Airflow.
-
Updated
May 14, 2021 - Python
Data pipelines created and monitored using Airflow to feed data into Redshift
-
Updated
Feb 20, 2021 - Python
Building a personal activity feed with airflow DAGs
-
Updated
Jan 23, 2020 - Python
Google Composer Airflow
-
Updated
Jan 19, 2020 - Python
Setting up airflwo with best practices
-
Updated
Mar 1, 2022 - Python
Improve this page
Add a description, image, and links to the dags topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the dags topic, visit your repo's landing page and select "manage topics."
Describe the bug
At the moment, Temporary tables names are created using:
https://github.com/astro-projects/astro/blob/9a565e8fa0fa68b4be0c0dbd1866e0b531b8b902/src/astro/sql/table.py#L78-L86
Where
MAX_TABLE_NAME_SIZEis currently 63 characters (e.g. Postgres does not support tables with longer names).The problem is that depending on the DAG ID and the task names, there will be colli