Spotify

Repositories

• scio

  A Scala API for Apache Beam and Google Cloud Dataflow.

  bigquery data streaming scala beam google-cloud ml
  Scala Apache-2.0 421 2,106 73 (22 issues need help) 6 Updated Mar 27, 2021

• scio-idea-plugin

  Scio IDEA plugin

  scala intellij idea scala-macros
  Scala Apache-2.0 13 28 3 0 Updated Mar 27, 2021

• heroic Archived

  The Heroic Time Series Database

  java elasticsearch cassandra monitoring time-series ha tsdb
  Java Apache-2.0 107 838 67 3 Updated Mar 26, 2021

• dockerfile-mode

  An emacs mode for handling Dockerfiles
  Emacs Lisp Apache-2.0 64 406 9 0 Updated Mar 26, 2021

• styx

  "The path to execution", Styx is a service that schedules batch data processing jobs in Docker containers on Kubernetes.
  Java Apache-2.0 41 196 4 7 Updated Mar 26, 2021

• apollo

  Java libraries for writing composable microservices

  java framework http-server java-8
  Java Apache-2.0 216 1,606 13 5 Updated Mar 26, 2021

• scio.g8

  A Giter8 template for scio

  scala giter8-template scio
  Scala Apache-2.0 16 24 2 0 Updated Mar 26, 2021

• web-scripts

  A collection of base configs and CLI wrappers used to speed up development @ Spotify.
  TypeScript Apache-2.0 43 288 16 15 Updated Mar 26, 2021

• lemur

  Forked from Netflix/lemur

  Repository for the Lemur Certificate Manager
  Python Apache-2.0 279 0 0 3 Updated Mar 25, 2021

• XCLogParser

  Tool to parse Xcode and xcodebuild logs stored in the xcactivitylog format

  swift xcode swift-package-manager xcactivitylog
  Swift Apache-2.0 55 998 10 1 Updated Mar 26, 2021

• cassandra-medusa

  Apache Cassandra backup and restore tool
  Python Apache-2.0 3 26 3 2 Updated Mar 25, 2021

• luigi

  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

  python hadoop scheduling orchestration-framework luigi
  Python Apache-2.0 2,239 14,359 53 22 Updated Mar 25, 2021

• scanctl

  A tool to facilitate managing Whitesource data
  Python Apache-2.0 3 0 0 2 Updated Mar 25, 2021

• docker_interface

  🐳 Declarative interface for building images and running commands in containers using Docker.

  docker
  Python Apache-2.0 12 22 3 2 Updated Mar 25, 2021

• ramlfications

  Python parser for RAML
  RAML Apache-2.0 48 234 40 (17 issues need help) 11 Updated Mar 25, 2021

• flink-on-k8s-operator

  Forked from GoogleCloudPlatform/flink-on-k8s-operator

  Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
  Go Apache-2.0 138 0 0 0 Updated Mar 25, 2021

• klio

  Smarter data pipelines for audio.

  signal-processing data-pipeline audio-processing media-processing
  Python Apache-2.0 29 560 4 (1 issue needs help) 1 Updated Mar 25, 2021

• magnolify

  A collection of Magnolia add-on modules

  cats bigquery scala avro tensorflow google-cloud datastore
  Scala Apache-2.0 17 96 9 0 Updated Mar 25, 2021

• ratatool

  A tool for data sampling, data generation, and data diffing

  bigquery scala protobuf avro parquet scalacheck
  Scala Apache-2.0 53 278 17 (2 issues need help) 23 Updated Mar 25, 2021

• flyte-flink-plugin

  Flyte Flink k8s plugin.
  Go Apache-2.0 1 0 1 0 Updated Mar 25, 2021

• zoltar

  Common library for serving TensorFlow, XGBoost and scikit-learn models in production.

  java machine-learning tensorflow xgboost model-serving
  Java Apache-2.0 30 116 16 (11 issues need help) 10 Updated Mar 25, 2021

• dbeam

  DBeam exports SQL tables into Avro files using JDBC and Apache Beam
  1 package Java Apache-2.0 42 149 11 (1 issue needs help) 12 Updated Mar 25, 2021

• ulogger

  A simple micrologging framework

  logging
  Python Apache-2.0 4 7 0 2 Updated Mar 24, 2021

• NFDriver

  A cross platform C++ audio driver with low latency.
  C++ Apache-2.0 15 85 0 2 Updated Mar 23, 2021

• gordon-introspection

  Introspection Server Plugin for Gordon: Event-Driven Cloud DNS registration
  Python Apache-2.0 0 0 0 0 Updated Mar 23, 2021

• noether

  Scala Aggregators used for ML Model metrics monitoring

  machine-learning scala
  Scala Apache-2.0 11 71 4 1 Updated Mar 23, 2021

• tfreader

  TensorFlow TFRecord reader CLI tool

  cats cli scala tensorflow fs2 tfrecords graal-native
  Scala Apache-2.0 12 36 3 (2 issues need help) 1 Updated Mar 23, 2021

• featran

  A Scala feature transformation library for data science and machine learning

  data scala spark tensorflow ml xgboost algebird
  Scala Apache-2.0 62 422 10 (5 issues need help) 1 Updated Mar 23, 2021

• gcs-tools

  GCS support for avro-tools, parquet-tools and protobuf

  protobuf avro google-storage gcp gcs parquet gcs-connector
  Java Apache-2.0 8 57 1 0 Updated Mar 22, 2021

• big-data-rosetta-code

  Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

  scala spark bigdata scalding scio
  Scala Apache-2.0 29 255 1 1 Updated Mar 22, 2021