A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
Data Prepper is a component of the OpenSearch project that accepts, filters, transforms, enriches, and routes data at scale.
Use any public GitHub repository as a source and ask questions through ChatGPT about it
A free, open-source, web-based self-service BI tailor-made for clickhouse, google bigquery, mysql, postgresql, vertica
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL)
IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.
Extensible streaming ingestion pipeline on top of Apache Spark
Media Management System: ingestion, processing, encoding, delivery, ...
A simple demo application for uploading, ingesting, embedding videos and converting them to mp4s. From api.video (https://api.video)
Spark in Action, 2e - chapter 9 - Advanced ingestion: finding data sources and building your own
Parallel Streaming Transformation Loader
Periodically ingest incremental updates (inserts / deletes) into BigQuery using Cloud Composer / Airflow orchestration workflow
👥 [WIP] An experimental High Available Reverse Proxy for Massive Asynchronous Message Consumption
Read-only mirror of https://gitlab.com/sorcero/community/ingestum
tagbase-server is a data management web service for working with eTUFF and nc-eTAG files.
Add a description, image, and links to the ingestion topic page so that developers can more easily learn about it.
To associate your repository with the ingestion topic, visit your repo's landing page and select "manage topics."