data-streaming

Apache Kafka running on Kubernetes

An extensible distributed system for reliable nearline data streaming at scale

Sample Applications for Pravega.

A Python library for machine-learning and feedback loops on streaming data

Strimzi canary

Apache Kafka for the Hybrid IoT

Udacity Data Streaming Nanodegree Program

A simple, time-tested, family of random hash functions in Java, based on CRC32, affine transformations, and the Mersenne Twister. 🎲

A Tool for Timed Patten Matching with Automata-Based Acceleration

Ixian S2 end to end data streaming network software

A lightweight fast data streaming library for raspberry pi in python.

Elastic Stack with Nginx, Logstash and Beats demo

Stream processor that's consuming two topics and process data

This repository contains a collection of three Data Engineering capstone projects made for the DTU Data Engineering course 02807: Computational Tools for Data Science

AutoML Techniques for Data Streams - Research Paper

Subscribe to datasets and be notified of changes via webhook

Data Stream Generator - a lightweight C# .NET based application, which parses TOML-configuration files for specifications of time series, generates these series and successively streams them via MQTT.

Stream data into pipeline in near-real-time using Kafka

Fault-tolerant streaming pipeline for real-time soccer match analysis.

Design data streaming architecture and API for a real-life application called the Step Trending Electronic Data Interface (STEDI). It is a working application used to assess fall risk for seniors. When a senior takes a test, they are scored using an index which reflects the likelihood of falling, and potentially sustaining an injury in the course of walking. STEDI uses a Redis datastore for risk score and other data. The Data Science team has completed a working graph for population risk at a STEDI clinic. The problem is the data is not populated yet. You will work with Kafka Connect Redis Source events and Business Events to create a Kafka topic containing anonymized risk scores of seniors in the clinic.

HFlow is a platform for I/O forwarding managed elastically, dynamically, and actively

AWS Firehose Sender - Sending data securely through a Firehose stream using boto3

Public Transit Status with Apache Kafka

This Java program read data from a weather station (Davis Vantage Pro2) and store it in a SQL database

Data Structures and Algorithms Specialization | Coursera

Example to build a data streaming using GCP

Meet Apache Kafka

Workshop Database RDS Postgre Integration and offloading to Data Lake, and visualize the data to QuickSight

Code for the conference paper "Streaming Data through the IoT via Actor-Based Semantic Routing Trees" from VLIOT@VLDB 2021.