flyte

Kubernetes-native workflow automation platform for complex, mission-critical data and ML processes at scale. It has been battle-tested at Lyft, Spotify, Freenome, and others and is truly open-source.

Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.

Flyte binds together the tools you use into easily defined, automated workflows

A apache commons style library in Golang, use by the Flyte project. Contains utilities for metrics, pflags, config management, storage abstraction, caching etc

Flyte Documentation 📖

Data Catalog is a service for indexing parameterized, strongly-typed data artifacts across revisions. It also powers Flytes memoization system

FlytePropeller is a Kubernetes native operator, that executes Flyte Workflows and Tasks. It has its own kubectl-flyte CLI to interact and is extensible using the flyteplugins/pluginmachinery interface

Control Plane for Flyte. Flyteadmin is a gRPC + REST Service written in golang and uses a RDBMs to store meta information and management information for Flyte Tasks and Workflows.

A cross platform CLI for Flyte. Written in Golang. Offers an intuitive interface to Flyte https://docs.flyte.org/projects/flytectl/en/latest/

Java/Scala library for easily authoring Flyte tasks and workflows

Specification of the IR for Flyte workflows and tasks. Also Interfaces for all backend services. https://docs.flyte.org/projects/flyteidl/en/stable/

The user interface for Flyte

Flyte Backend Plugins contributed by the Flyte community.

Flyte Flink k8s plugin.

Javascript sdk for Flyte

A repository of boilerplate code

CookieCutter template for getting started with Flyte python projects

A Go library designed to make the writing of flyte packs simple

hactoberfest2021

Miscellaneous tools for Flyte contributors