Topic: streaming-data

onurakpolat / awesome-bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

awesome bigdata data-warehouse data-analytics data-visualization data-stream database data-science data awesome-list distributed-database series-database stream-processing streaming-data visualize-data

Updated Feb 12, 2019

johnkerl / miller

2.1k

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

C Updated Feb 24, 2019 3 issues need help

Jeffail / benthos

1.7k

A stream processor for dull stuff written in Go

buffer message-queue bridge http-bridge pipeline multiplexer stream-processing streaming-data message-bus logs

Go Updated Mar 21, 2019 3 issues need help

RaRe-Technologies / smart_open

1.2k

Utils for streaming large files (S3, HDFS, gzip, bz2...)

python s3 hdfs webhdfs boto streaming file streaming-data gzip-stream bz2

Python Updated Mar 22, 2019

pravega / pravega

654

Pravega - Streaming as a new software defined storage primitive

streaming streaming-data distributed-storage real-time-data data-ingestion

Java Updated Mar 22, 2019

Stratio / sparta

470

Real Time Analytics and Data Pipelines based on Spark Streaming

streaming-data scala stratio spark streaming spark-streaming olap kafka hdfs workflow sparta analytics real-time sparksql stratio-sparta lambda triggers

Scala Updated Jul 7, 2017

infoslack / awesome-kafka

173

A list about Apache Kafka

kafka streaming-data data-pipeline stream-processing apache-kafka apache-spark kafka-streams infrastructure data-processing

Updated Jan 2, 2019

amidst / toolbox

86

A Java Toolbox for Scalable Probabilistic Machine Learning

data-science machine-learning bayesian-methods bayesian-networks streaming-data latent-variable-models graphical-models

Java Updated Nov 12, 2018

scikit-multiflow / scikit-multiflow

83

A multi-output/multi-label and stream data framework. Inspired by MOA and MEKA, following scikit-learn's philosophy.

scikit scikit-learn stream streaming-data machine-learning meka moa

Python Updated Mar 22, 2019 1 issue needs help

streamdataio / streamdataio-js

71

Streamdata.io Javascript package containing SDK, documentation and sample applications

sse server-sent-events streaming-data js nodejs angular vuejs streamdataio

JavaScript Updated Dec 17, 2018

GridProtectionAlliance / gsf

67

Grid Solutions Framework

time-series synchrophasor libraries electric communications gsf comtrade ieee-c37118 ieee-1344 macrodyne pqdif osi-pi complex-event-processing stream-processing streaming-data stream-processing-engine pmu phasor-measurement-unit

C# Updated Mar 9, 2019

seznam / euphoria

65

Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent…

big-data apache-flink apache-spark java-api hadoop kafka hdfs unified-bigdata-processing streaming-data batch-processing

Java Updated Feb 21, 2019

GridProtectionAlliance / openPDC

55

Open Source Phasor Data Concentrator

phasor-data-concentrator openpdc pdc ieee-c37118 ieee-1344 bpa-pdc-stream iec61850 time-series complex-event-processing hadoop naspi streaming-data stream-processing stream-processing-engine pmu phasor-measurement-unit synchrophasor

C# Updated Mar 18, 2019 3 issues need help

swimos / swim

44

Decentralized, end-to-end streaming application and real-time user interface platform—home of the WARP multiplexed st…

Java Updated Mar 10, 2019

bbejeck / kafka-streams-in-action

40

Source code for the Kafka Streams in Action Book

kafka kafkastreams streaming stream-processing streaming-data

Java Updated Aug 28, 2018

radicalbit / NSDb

36

Natural Series Database

database nosql nosql-databases time-series streaming-data analytics data-analytics scala akka lucene kpi metrics

Scala Updated Mar 15, 2019

RxSwiftCommunity / RxHttpClient

33

Simple Http client (Use RxSwift for stream data)

rxswift swift streaming-data nsurlsession

Swift Updated Feb 25, 2019

oharastream / ohara

30

OharaStream - A powerful ETL tool and easy-to-use visual stream processing

kafka kafka-streams kafka-connect pipeline stream-processing streaming-data etl k8s

Scala Updated Mar 22, 2019 1 issue needs help

lsds / Saber

27

Window-Based Hybrid CPU/GPU Stream Processing Engine

stream-processing hybrid multicore gpu high-throughput saber stream streaming-data streaming sliding-windows multicore-cpu

Java Updated Jan 28, 2019

systemaccounting / mxfactorial

23

Combinatorial Game Theory through Conformal Geometric Algebra

science capital transaction game-theory fintech bivector combinatorial-optimization economics data-science combinatorial-game finance price-discovery mathematical-physics stream-processing streaming-data streaming-api banking cga geometric-algebra

JavaScript Updated Mar 21, 2019

andrewssobral / imtsl

21

IMTSL - Incremental and Multi-feature Tensor Subspace Learning

tensor background-subtraction subspace-learning matlab streaming-data foreground-detection

MATLAB Updated Feb 23, 2015

kLabUM / rrcf

21

🌲 Implementation of the Robust Random Cut Forest algorithm for anomaly detection on streams

outliers detect-outliers tree random-forest machine-learning anomaly-detection streaming-data python robust-random-cut-forest

Python Updated Mar 7, 2019

marrow / cinje

16

A Pythonic and ultra fast template engine DSL.

python pypy template-engine streaming-data text-processing dsl cpython python-2 python-3

Python Updated Mar 7, 2019

pravega / pravega-samples

15

Sample Applications for Pravega.

pravega streaming-data data-streaming sample-app

Java Updated Mar 21, 2019

simplygreatwork / godsend

14

A simple and eloquent workflow for streaming messages to micro-services.

javascript messaging message-bus message-broker message-passing microservice microservices microservices-architecture broker filter bus stream stream-processing streaming-data streaming-api streams

JavaScript Updated Jun 8, 2017

matteodellamico / flexible-clustering

14

Clustering for arbitrary data and dissimilarity function

clustering non-metric streaming-data flexible-clustering

Python Updated Feb 20, 2019

shreybatra / Twitter-Stream-API-Dataset

14

Twitter Dynamic Dataset Api. Create any dataset YOU want.

rest-api flask tweepy-api streaming-data twitter-api python python3 mongodb dataset twitter-dataset twitter-dynamic-dataset

Python Updated Mar 9, 2019 3 issues need help

ominibyte / richflow

12

A Node.js and JavaScript synchronous data pipeline processing, data sharing and stream processing library. Actionable…

javascript nodejs data-processor pipeline-framework data-pipeline synchronous flow data-stream data-transformation streaming-data pipe-data data-flow

JavaScript Updated Aug 8, 2017

IRC-SPHERE / HyperStream

12

HyperStream

stream-processing workflow-engine compute-engine streaming-data hyperstream sphere

Python Updated Aug 20, 2018 4 issues need help

Ranlot / spark-streaming-visualize

11

Simple demonstration of how to build a complex real time machine learning visualization tool.

apache-spark zeromq flask streaming-data

Python Updated Mar 26, 2016

Please note that GitHub no longer supports Internet Explorer.

streaming-data

Repositories 153