cTuning foundation

Repositories

• ck-mlperf

  Collective Knowledge repository to automate MLPerf - a broad ML benchmark suite for measuring performance of ML software frameworks, ML hardware accelerators, and ML cloud platforms:
  Python BSD-3-Clause 13 27 5 0 Updated Sep 3, 2020

• ck

  Collective Knowledge framework (CK) helps to organize any software project as a database of reusable components with common automation actions and extensible meta descriptions based on FAIR principles (findability, accessibility, interoperability, and reusability). See real-world use cases from Arm, IBM, General Motors, MLPerf, RPi, and ACM:

  elasticsearch workflow devops json automation database rest-api
  Python BSD-3-Clause 50 339 13 (4 issues need help) 0 Updated Sep 3, 2020

• cbench

  cBench provides a unified CLI and API to reproduce results from ML&systems research papers on bare-metal platforms and participate in collaborative benchmarking and optimization using live scoreboards. See the real-world example for the MLPerf benchmark:

  benchmarking machine-learning reproducible-research optimization collaboration open-science systems
  Python Apache-2.0 2 5 0 0 Updated Sep 3, 2020

• ck-tensorrt

  Collective Knowledge repository for NVIDIA's TensorRT
  Python BSD-3-Clause 13 36 2 0 Updated Sep 3, 2020

• ck-pytorch

  Integration of PyTorch to Collective Knowledge workflow framework to provide unified CK JSON API for AI (customized builds across diverse libraries and hardware, unified AI API, collaborative experiments, performance optimization and model/data set tuning):
  Python 2 3 0 0 Updated Sep 3, 2020

• ck-nntest

  CK-NNTest: collaboratively validating, benchmarking and optimizing neural net operators across platforms, frameworks and datasets
  C++ BSD-3-Clause 4 12 2 0 Updated Sep 3, 2020

• ck-tensorflow

  Collective Knowledge components for TensorFlow (code, data sets, models, packages, workflows):

  metadata automation pipelines apis knowledge-management workflow-automation package-management
  Python 23 88 9 (2 issues need help) 0 Updated Sep 3, 2020

• ck-analytics

  Collective Knowledge repository with actions to unify the access to different predictive analytics engines (scipy, R, DNN) from software, command line and web-services via CK JSON API:

  json-api reproducible-research json-metadata collaborative-research collective-knowledge open-research dnn-as-a-service
  Python 4 36 5 (3 issues need help) 0 Updated Sep 3, 2020

• ck-autotuning

  CK automation actions to let users implement portable, customizable and reusable program workflows for reproducible, collaborative and multi-objective benchmarking, optimization and SW/HW co-design:

  android python windows macos linux workflow json-api
  Python BSD-3-Clause 21 51 11 (5 issues need help) 0 Updated Sep 3, 2020

• ck-env

  CK repository with components and automation actions to enable portable workflows across diverse platforms including Linux, Windows, MacOS and Android. It includes software detection plugins and meta packages (code, data sets, models, scripts, etc) with the possibility of multiple versions to co-exist in a user or system environment:

  android python windows macos linux package-manager tools
  Python BSD-3-Clause 21 59 26 (6 issues need help) 0 Updated Sep 3, 2020

• ck-dissemination-modules

  CK dissemination modules
  Python 0 25 1 0 Updated Aug 19, 2020

• ck-coral

  Collective Knowledge workflows for the Coral EdgeTPU accelerator
  BSD-3-Clause 2 0 0 0 Updated Aug 7, 2020

• ck-math

  Collective Knowledge packages for various mathematical libs to be plugged into portable and customizable CK research workflows:
  C++ BSD-3-Clause 7 35 5 (1 issue needs help) 0 Updated Aug 7, 2020

• ck-openvino

  Collective Knowledge workflows for OpenVINO Toolkit (Deep Learning Deployment Toolkit)
  C++ BSD-3-Clause 3 5 6 (1 issue needs help) 0 Updated Aug 6, 2020

• ck-armnn

  Collective Knowledge workflows for ArmNN
  Shell BSD-3-Clause 5 3 2 1 Updated Aug 4, 2020

• ck-web

  Collective Knowledge web extension to browse CK repositories, visualize interactive graphs and articles, render CK-based websites, implement simple web services with JSON API (for example to crowdsource experiments or unify access to DNN). Demos of interactive articles, graphs and crowdsourced experiments:

  web-server json-api reproducible-research web-service collaborative-research collective-knowledge interactive-articles
  CSS 3 30 0 0 Updated Jul 26, 2020

• ck-old-packages

  Collective Knowledge repository to archive outdated packages
  CMake 2 0 0 0 Updated Jul 13, 2020

• ck-website

  CK repository for cKnowledge.org website:
  CSS 2 2 0 6 Updated Jul 7, 2020

• ck-scc

  The procedures and a workflow to prepare Student Cluster Competition submissions:

  api devops research reproducible-research reproducibility workflow-automation collective-knowledge
  Python BSD-3-Clause 1 5 0 0 Updated May 30, 2020

• ck-artifact-evaluation

  Public CK repository with materials and workflows to reproduce results from published papers or open competitions at ACM, IEEE and NeurIPS conferences and journals

  reproducible-research conferences journals collaborative-research artifact-evaluation artifact-sharing public-reviewing
  JavaScript 3 27 0 0 Updated Apr 22, 2020

• ck-object-detection

  CK research workflows for object detection
  Python BSD-3-Clause 1 6 1 0 Updated Apr 15, 2020

• ck-quantum

  Miscellaneous resources for Quantum Collective Knowledge
  Python 6 30 3 0 Updated Jan 8, 2020

• reproduce-sysml19-paper-aggregathor

  Reproducibility report and the Collective Knowledge workflow for the MLSys'19 paper "AggregaThor: Byzantine Machine Learning via Robust Gradient Aggregation"
  Python 0 2 6 0 Updated Jan 5, 2020

• ck-rpi-optimization-results

  Demonstration of compiler autotuning, crowd-tuning and machine learning on RPi3 via customizable Collective Knowledge workflow framework with a portable package manager. This technology supports Pareto-efficient software/hardware co-design tournaments of deep learning in terms of speed, accuracy, energy, costs:
  HTML 1 19 0 0 Updated Oct 28, 2019

• ck-crowdtuning

  Collective Knowledge crowd-tuning extension to let users crowdsource their experiments (using portable Collective Knowledge workflows) such as performance benchmarking, auto tuning and machine learning across diverse platforms with Linux, Windows, MacOS and Android provided by volunteers. Demo of DNN crowd-benchmarking and crowd-tuning:

  iot machine-learning optimization collaboration collective-intelligence mobile-phones knowledge-sharing
  Python 3 33 8 (2 issues need help) 0 Updated Oct 23, 2019

• ck-ehive

  CK workflows for the eHive project
  Python BSD-3-Clause 1 0 0 0 Updated Aug 29, 2019

• ck-graph-analytics

  Collective Knowledge repository with workflows and packages for graph analytics applications
  TeX 3 2 1 0 Updated Jul 23, 2019

• ck-guide-images

  Images for CK documentation
  TeX 0 23 0 0 Updated Jun 30, 2019

• ck-crowd-papers

  Collaborative research papers auto-generated via Collective Knowledge framework with the help of the community
  0 1 0 0 Updated Jun 20, 2019

• reproindex

  [OUTDATED] Index of reproduced papers with reusable research components and unified workflows. Moved to
  Python 0 2 0 0 Updated Jun 20, 2019