Data integration platform for ELT pipelines from APIs, databases & files to warehouses & lakes.

An orchestration platform for the development, production, and observation of data assets.

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.

🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.

The open source high performance data integration platform built for developers.

Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

Upserts, Deletes And Incremental Processing on Big Data.

A data integration framework

Privacy and Security focused Segment-alternative, in Golang and React

Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days

Community-curated list of software packages and data resources for single-cell, including RNA-seq, ATAC-seq, etc.

Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.

Lean and mean distributed stream processing system written in rust and web assembly.

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

BitSail is a distributed high-performance data integration engine which supports batch, streaming and incremental scenarios. BitSail is widely used to synchronize hundreds of trillions of data every day.

Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…

汇总Apache Hudi相关资料

Fast, sensitive and accurate integration of single-cell data with Harmony

NicheNet: predict active ligand-target links between interacting cells

SeaTunnel is a distributed, high-performance data integration platform for the synchronization and transformation of massive data (offline & real-time).