#
apache-airflow
Here are 140 public repositories matching this topic...
Curated list of resources about Apache Airflow
-
Updated
Aug 27, 2020
A series of DAGs/Workflows to help maintain the operation of Airflow
-
Updated
Aug 7, 2020 - Python
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
python
airflow
spark
apache-spark
scheduler
s3
data-engineering
data-lake
warehouse
redshift
data-migration
livy
etl-framework
apache-airflow
emr-cluster
etl-pipeline
etl-job
data-engineering-pipeline
airflow-dag
goodreads-data-pipeline
-
Updated
Mar 9, 2020 - Python
Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes
-
Updated
Sep 9, 2020 - Shell
Dynamically generate Apache Airflow DAGs from YAML configuration files
-
Updated
Aug 21, 2020 - Python
barney-s
commented
Aug 9, 2018
Currently the env variables injected are specific to this docker image https://github.com/barney-s/docker-airflow
Align it with https://github.com/puckel/docker-airflow and make necessary changes in the operator to make it work with both.
related to GoogleCloudPlatform/airflow-operator#10
A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
-
Updated
Jul 15, 2020 - Python
terrytangyuan
commented
Sep 2, 2020
Currently the argument type in Artifact is not used. We should support different types of artifacts with various artifact repository (e.g. AWS and GCS).
Example DAGs using hooks and operators from Airflow Plugins
airflow
mongodb
etl
google-analytics
imap
selenium
sftp
mailgun
salesforce
facebook-ads
dbt
hubspot
dag
marketo
singer
apache-airflow
marketo-sdk
airflow-plugins
-
Updated
Jul 24, 2018 - Python
A web frontend for scheduling Jupyter notebook reports
docker
kubernetes
airflow
jupyter
notebook
jupyter-notebook
nteract
luigi
celery
jupyterlab
dask
jupyter-notebooks
phosphorjs
apache-airflow
papermill
scheduling-notebooks
-
Updated
Feb 28, 2020 - Python
A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
airflow
high-availability
scheduler-failover-controller
apache-airflow
airflow-scheduler
airflow-cluster
-
Updated
Dec 24, 2019 - Python
A Helm chart to install Apache Airflow on Kubernetes
-
Updated
Sep 4, 2020 - Shell
CLI that makes it easy to create, test and deploy Airflow DAGs to Astronomer
-
Updated
Sep 4, 2020 - Go
Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker with CeleryExecutor
-
Updated
Aug 1, 2020 - HCL
Ansible role to install Apache Airflow
-
Updated
Apr 29, 2020 - Python
A plugin for Apache Airflow that allows you to edit DAGs in browser
-
Updated
Sep 7, 2020 - JavaScript
-
Updated
Jan 6, 2020 - Python
Basic tutorial of using Apache Airflow
-
Updated
Sep 25, 2018 - Python
Using Apache Airflow to schedule web scrapers
-
Updated
Oct 3, 2018 - Python
Export Airflow metrics (from mysql) in prometheus format
-
Updated
Mar 6, 2019 - Go
Plugin offering views, operators, sensors, and more developed at Pandora Media.
-
Updated
May 3, 2018 - Python
-
Updated
Jun 10, 2020 - Python
Terraform module for a PostgreSQL-backed Apache Airflow instance
-
Updated
May 16, 2018 - HCL
-
Updated
Apr 13, 2019 - Python
Improve this page
Add a description, image, and links to the apache-airflow topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the apache-airflow topic, visit your repo's landing page and select "manage topics."
We use PyDocStyle in pre-commit to enforce docstring style: https://github.com/apache/airflow/blob/079d7b59464921f7fd7d615b6c74195a9c2f831f/.pre-commit-config.yaml#L195-L203
We follow pep257 style (http://www.pydocstyle.org/en/stable/error_codes.html) for checks.
Currently, we ignore the following rules:
D100,D102,D104,D105,D107,D200,D202,D204,D205,D