LinkedIn

Repositories

• rest.li

  Rest.li is a REST+JSON framework for building robust, scalable service architectures using dynamic discovery and simple asynchronous APIs.
  Java 433 2,074 23 14 Updated Sep 1, 2020

• linkedin-calcite

  LinkedIn's version of Apache Calcite
  Java Apache-2.0 3 4 0 8 Updated Sep 1, 2020

• brooklin

  An extensible distributed system for reliable nearline data streaming at scale

  java distributed-systems kafka linkedin scalability change-data-capture data-streaming
  Java BSD-2-Clause 81 614 6 12 Updated Sep 1, 2020

• zookeeper

  Forked from apache/zookeeper

  Mirror of Apache Hadoop ZooKeeper
  Java Apache-2.0 5,359 2 0 0 Updated Sep 1, 2020

• cruise-control

  Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of Kafka clusters.
  Java BSD-2-Clause 324 1,597 55 (7 issues need help) 3 Updated Aug 31, 2020

• ambry

  Distributed object store
  Java Apache-2.0 249 1,396 112 5 Updated Aug 31, 2020

• datahub

  A Generalized Metadata Search & Discovery Tool

  metadata big-data linkedin data-catalog datahub search-and-discovery
  4 packages TypeScript Apache-2.0 651 2,191 35 16 Updated Aug 31, 2020

• li-apache-kafka-clients

  li-apache-kafka-clients is a wrapper library for the Apache Kafka vanilla clients. It provides additional features such as large message support and auditing to the Java producer and consumer in the open source Apache Kafka.
  Java BSD-2-Clause 47 103 7 5 Updated Aug 31, 2020

• LiTr

  Lightweight hardware accelerated video/audio transcoder for Android.
  Java BSD-2-Clause 35 176 10 0 Updated Aug 31, 2020

• spark-tfrecord

  Read and write Tensorflow TFRecord data from Apache Spark.
  Scala BSD-2-Clause 22 82 1 1 Updated Aug 31, 2020

• dexmaker

  A utility for doing compile or runtime code generation targeting Android's Dalvik VM
  Java Apache-2.0 202 1,356 22 2 Updated Aug 30, 2020

• shiv

  shiv is a command line utility for building fully self contained Python zipapps as outlined in PEP 441, but with all their dependencies included.
  Python BSD-2-Clause 58 1,033 22 6 Updated Aug 29, 2020

• css-blocks

  High performance, maintainable stylesheets.

  css sass css-modules
  TypeScript BSD-2-Clause 152 6,213 135 (4 issues need help) 43 Updated Aug 29, 2020

• kafka-monitor

  Xinfra Monitor monitors the availability of Kafka clusters by producing synthetic workloads using end-to-end pipelines to obtain derived vital statistics - E2E latency, service produce/consume availability, offsets commit availability & latency, message loss rate and more.

  monitor metrics latency topic cluster broker leader
  Java Apache-2.0 374 1,581 6 3 Updated Aug 28, 2020

• TonY

  TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

  machine-learning deep-learning hadoop tensorflow hadoop-yarn
  Java 137 591 37 (2 issues need help) 1 Updated Aug 28, 2020

• detext

  DeText: A Deep Neural Text Understanding Framework for Ranking and Classification Tasks

  nlp deep-neural-networks ranking classification text-embeddings detext-framework
  Python BSD-2-Clause 87 844 8 1 Updated Aug 27, 2020

• camus

  LinkedIn's previous generation Kafka to HDFS pipeline.
  Java 477 856 0 3 Updated Aug 27, 2020

• avro-util

  Collection of utilities to allow writing java code that operates across a wide range of avro versions.
  Java BSD-2-Clause 26 27 4 3 Updated Aug 26, 2020

• gdmix

  A deep learning personalization framework
  Python BSD-2-Clause 1 7 0 1 Updated Aug 26, 2020

• shaky-android

  Shake to send feedback for Android.

  android feedback linkedin android-library
  Java Apache-2.0 42 135 6 3 Updated Aug 25, 2020

• spaniel

  LinkedIn's JavaScript viewport tracking library and IntersectionObserver polyfill
  JavaScript Apache-2.0 29 77 11 1 Updated Aug 25, 2020

• spark

  Forked from apache/spark

  Apache Spark - A unified analytics engine for large-scale data processing
  Scala Apache-2.0 22,427 6 0 0 Updated Aug 24, 2020

• Hakawai

  A powerful, extensible UITextView.
  Objective-C Apache-2.0 94 735 38 0 Updated Aug 24, 2020

• rest.li-test-suite

  A language-independent Rest.li test suite.
  Java BSD-2-Clause 4 2 1 1 Updated Aug 24, 2020

• parseq

  Asynchronous Java made easier
  Java Apache-2.0 260 980 46 7 Updated Aug 24, 2020

• Spyglass

  A library for mentions on Android
  Java Apache-2.0 119 328 9 0 Updated Aug 21, 2020

• LiFT

  The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.

  machine-learning scala spark linkedin fairness fairness-ai fairness-ml
  Scala BSD-2-Clause 5 52 0 0 Updated Aug 21, 2020

• coral

  Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.
  Java BSD-2-Clause 12 62 0 0 Updated Aug 20, 2020

• kafka

  Forked from apache/kafka

  Mirror of Apache Kafka
  Java Apache-2.0 8,917 101 0 5 Updated Aug 20, 2020

• iceberg

  A temporary home for LinkedIn's changes to Apache Iceberg (incubating)
  Java Apache-2.0 9 13 0 2 Updated Aug 19, 2020