pipelines

Concourse is a container-based continuous thing-doer written in Go.

Build data pipelines, the easy way 🛠️

MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle

The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️

ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.

🧙 A modern replacement for Airflow.

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

Event-driven automation framework

A Julia machine learning framework

Elyra extends JupyterLab with an AI centric approach.

Framework for large distributed pipelines

The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.

Hop Orchestration Platform

Your CLI for ELT+. It's open source, flexible, and scales to your needs. Confidently move, transform, and test your data using tools you know with a data engineering workflow you’ll love. ----------------------------------------This month, every ⭐ on GitHub removes 2 lb/~1 kg of trash from our waterways 🌊

🦊 Test your Gitlab CI Pipelines changes locally using Docker.

Livekeys - Automation Platform with support for live scripting.

Azure DevOps Extension for Azure CLI

Zero-copy I/O primitives and pipelines for Go. Linux-specific.

pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.

Event triggering with Tekton!