#

distillation

Here are 40 public repositories matching this topic...

IntelLabs / distiller

Star

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

deep-neural-networks jupyter-notebook pytorch regularization pruning quantization group-lasso distillation onnx truncated-svd network-compression pruning-structures early-exit automl-for-compression

Updated Oct 27, 2020
Jupyter Notebook

FLHonker / Awesome-Knowledge-Distillation

Star

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2020)。

deep-learning transfer-learning model-compression distillation kd knowldge-distillation

Updated Oct 19, 2020

airaria / TextBrewer

Star

A PyTorch-based knowledge distillation toolkit for natural language processing

nlp knowledge pytorch bert distillation

Updated Sep 4, 2020
Python

GMvandeVen / continual-learning

Star

PyTorch implementation of various methods for continual learning (XdG, EWC, online EWC, SI, LwF, GR, GR+distill, RtF, ER, A-GEM, iCaRL).

deep-learning artificial-neural-networks replay incremental-learning variational-autoencoder generative-models lifelong-learning distillation continual-learning elastic-weight-consolidation replay-through-feedback icarl gradient-episodic-memory

Updated Aug 10, 2020
Python

szq0214 / MEAL-V2

Star

MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks

pytorch imagenet model-architecture compression-algorithm pre-trained meal imagenet-dataset distillation resnet50 mobilenetv3 efficientnet distillation-model

Updated Oct 7, 2020
Python

CLUEbenchmark / CLUEPretrainedModels

Star

高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型

text-classification corpus dataset chinese semantic-similarity pretrained-models sentence-classification albert bert sentence-analysis distillation sentence-pairs roberta

Updated Jul 8, 2020
Python

qiangsiwei / bert_distill

Star

BERT distillation（基于BERT的蒸馏实验）

nlp classification bert distillation

Updated Jul 30, 2020
Python

fxmeng / filter-grafting

Star

Filter Grafting for Deep Neural Networks(CVPR 2020)

filter pytorch pruning distillation grafting multi-network

Updated Jul 6, 2020
Python

khurramjaved96 / incremental-learning

Star

Pytorch implementation of ACCV18 paper "Revisiting Distillation and Incremental Classifier Learning."

machine-learning pytorch convolutional-neural-networks incremental-learning paper-implementations distillation

Updated Nov 1, 2019
Python

thu-ml / realsafe

Star

A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.

nes pca bim benchmark-framework evolutionary spsa boundary adversarial-machine-learning distillation fgsm adversarial-attacks deepfool adversarial-robustness mi-fgsm mmlda hgd

Updated Oct 13, 2020
Python

monologg / DistilKoBERT

Star

Distillation of KoBERT from SKTBrain (Lightweight KoBERT)

lightweight transformers pytorch bert korean-nlp distillation kobert

Updated Sep 5, 2020
Python

biosteam

BioSTEAMDevelopmentGroup / biosteam

Star

Open

Missing essential unit operation models

3

yoelcortes commented Dec 9, 2019

Any help in developing the following essential unit operations would be greatly appreciated:

Compressor
Turbine
~~Fenske-Gilliland-Underwood shortcut column~~ (added 3/22/2020)
~~Rigorous heat exchanger for heat integration~~ (added 6/6/2020)
Multi-component distillation models (preferably MESH equation based)
Kinetic fermentation models
~Centrifuge modeled by liquid-liquid equi

Read more

good first issue

xiongma / roberta-wwm-base-distill

Star

this is roberta wwm base distilled model which was distilled from roberta wwm by roberta wwm large

natural-language-processing tensorflow pretrained-models bert distillation roberta

Updated Mar 30, 2020
Python

GMvandeVen / brain-inspired-replay

Star

A brain-inspired version of generative replay for continual learning with deep neural networks (class-incremental learning on CIFAR-100; PyTorch code).

deep-learning artificial-neural-networks replay incremental-learning variational-autoencoder lifelong-learning distillation brain-inspired continual-learning elastic-weight-consolidation replay-through-feedback split-mnist generative-replay permuted-mnist split-cifar100 internal-replay synaptic-intelligence

Updated Sep 30, 2020
Python

yikaiw / RS-Nets

Star

[ECCV 2020] Code release for paper "Resolution Switchable Networks for Runtime Efficient Image Recognition" (In PyTorch and Tensorflow)

ensemble quantization multi-resolution efficient-inference distillation switchable rsnet eccv2020

Updated Aug 11, 2020
Python

leondgarse / Keras_insightface

Star

Insightface Keras implementation

keras triplet distillation arcface insightface tensorflow2 efficientnet resnest subcenter-arcface

Updated Oct 28, 2020
Jupyter Notebook

raphaelsty / mkb

Star

Knowledge Base Embedding By Cooperative Knowledge Distillation

machine-learning knowledge graph pytorch embeddings knowledge-graph triplets knowledge-graph-embeddings graph-embedding distillation wn18 mkb

Updated Oct 21, 2020
Python

kentaroy47 / DatasetCulling

Star

✂️ Dataset Culling: Faster training of domain specific models with distillation ✂️ (IEEE ICIP 2019)

pytorch object-detection distillation efficient-training dataset-culling

Updated Jan 31, 2020
Python

akimach / tensorflow-distillation-examples

Star

Knowledge distillation implemented in TensorFlow

python deep-learning neural-network tensorflow jupyter-notebook dark-knowledge distillation

Updated Aug 29, 2017
Jupyter Notebook

mapleam / model-compression-and-acceleration-4-DNN

Star

model-compression-and-acceleration-4-DNN

decomposition pruning quantization model-compression distillation

Updated Nov 29, 2018

bert-distillation

elephantmipt / bert-distillation

Star

Distillation of BERT model with catalyst framework

nlp catalyst bert distillation rubert distilbert

Updated Jun 7, 2020
Python

jangsoopark / IDN-TensorFlow

Star

TensorFlow Implementation of "Fast and Accurate Single Image Super-Resolution via Information Distillation Network" (CVPR 2018)

python tensorflow network information deeplearning idn superresolution distillation single-image-super-resolution cvpr2018 information-distillation-network

Updated Sep 25, 2020
Python

chen-judge / SKT

Star

Efficient Crowd Counting via Structured Knowledge Transfer (SKT, ACM MM 2020)

pytorch crowd-counting distillation

Updated Aug 26, 2020
Python

DTennant / distill_visual_priors

Star

2nd place solution of ECCV 2020 workshop VIPriors Image Classification Challenge, https://arxiv.org/abs/2008.00261

distillation self-supervised-learning

Updated Jul 24, 2020
Python

Syencil / mobile-yolov5-pruning-distillation

Star

mobile-yolov5 通道剪枝、蒸馏。ncnn转换并部署到android上，tensorRT部署到边缘端

pruning ncnn distillation yolov5 mobile-yolov5s

Updated Oct 26, 2020
Jupyter Notebook

XWalways / Papers

Star

Reading Papers

detection cv nas distillation

Updated Aug 7, 2020

vscherbo / distibot

Star

Distibot (DISTIller roBOT) is a Python program for Raspberry Pi (Raspbian) to control a whole process of distillation

python raspberry-pi raspbian distillation distiller-robot

Updated Oct 18, 2020
Python

jorgecote / DIstill-column

Star

Simulation model of a binary distillation column for a water-ethanol mix

column distillation water-ethanol

Updated Aug 14, 2017
MATLAB

satendrapandeymp / distillation_column

Star

Modelling of distillation column from basic mass balance equations.

design matlab process distillation

Updated Aug 31, 2017
MATLAB

mapleam / compression-pytorch

Star

experiments on pytorch

pruning quantization distillation

Updated Dec 5, 2018
Python

Improve this page

Add a description, image, and links to the distillation topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the distillation topic, visit your repo's landing page and select "manage topics."

You can’t perform that action at this time.