Build software better, together

neuralmagic / sparseml

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

nlp sparsity tensorflow keras pytorch deep-learning-algorithms image-classification deep-learning-library pruning object-detection transfer-learning automl computer-vision-algorithms onnx deep-learning-models sparsification pruning-algorithms smaller-models sparsification-recipes

Updated Jun 2, 2023
Python

tensorflow / model-optimization

Star

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

machine-learning sparsity compression deep-learning tensorflow optimization keras ml pruning quantization model-compression quantized-training quantized-neural-networks quantized-networks

Updated Jun 2, 2023
Python

PaddlePaddle / PaddleSlim

Star

PaddleSlim is an open-source library for deep model compression and architecture search.

sparsity compression detection transformer segmentation pruning quantization nas bert tensorrt distillation ernie yolov5 yolov6 yolov7

Updated Jun 1, 2023
Python

Intel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, sparsity, pruning, knowledge distillation, across different deep learning frameworks to pursue optimal inference performance.

sparsity deep-learning pruning quantization knowledge-distillation auto-tuning low-precision quantization-aware-training post-training-quantization

Updated Jun 2, 2023
Python

Eric-mingjie / network-slimming

Star

Network Slimming (Pytorch) (ICCV 2017)

sparsity deep-learning pytorch convolutional-neural-networks channel-pruning

Updated Nov 6, 2020
Python

openvinotoolkit / nncf

Star

Neural Network Compression Framework for enhanced OpenVINO™ inference

nlp sparsity compression deep-learning tensorflow transformers pytorch classification pruning object-detection quantization semantic-segmentation bert hawq onnx openvino mmdetection mixed-precision-training quantization-aware-training

Updated Jun 2, 2023
Python

wenwei202 / caffe

Star

Caffe for Sparse and Low-rank Deep Neural Networks

deep-neural-networks sparsity acceleration compression caffe low-rank-approximation sparse-convolution

Updated Mar 8, 2020
C++

mehtadushy / SelecSLS-Pytorch

Star

Reference ImageNet implementation of SelecSLS CNN architecture proposed in the SIGGRAPH 2020 paper "XNect: Real-time Multi-Person 3D Motion Capture with a Single RGB Camera". The repository also includes code for pruning the model based on implicit sparsity emerging from adaptive gradient descent methods, as detailed in the CVPR 2019 paper "On i…

sparsity deep-learning efficient cnn pytorch imagenet pruning siggraph pytorch-implementation cvpr2019 efficient-architectures

Updated Jul 23, 2020
Python

IntelLabs / SkimCaffe

Star

Caffe for Sparse Convolutional Neural Network

sparsity caffe intel convolution pruning winograd

Updated Dec 16, 2022
C++

The-Learning-And-Vision-Atelier-LAVA / SMSR

Star

[CVPR 2021] Exploring Sparsity in Image Super-Resolution for Efficient Inference

sparsity super-resolution efficient-inference

Updated Oct 18, 2021
Python

bwohlberg / sporco

Star

Sparse Optimisation Research Code

python sparsity optimization cuda admm sparse-coding dictionary-learning optimization-algorithms robust-pca fista convolutional-sparse-coding total-variation sparse-representations convolutional-dictionary-learning total-variation-minimization plug-and-play-priors

Updated Feb 18, 2022
Python

dcmocanu / sparse-evolutionary-artificial-neural-networks

Star

Always sparse. Never dense. But never say never. A Sparse Training repository for the Adaptive Sparse Connectivity concept and its algorithmic instantiation, i.e. Sparse Evolutionary Training, to boost Deep Learning scalability on various aspects (e.g. memory and computational time efficiency, representation and generalization power).

deep-neural-networks sparsity deep-learning scalability randomization neuroevolution deep-learning-algorithms classification evolutionary-algorithms artificial-neural-networks restricted-boltzmann-machine complex-networks deep-learning-papers multi-layer-perceptron generative-models sparse-neural-networks scalable-deep-learning sparse-training sparse-evolutionary-training adaptive-sparse-connectivity

Updated Jul 21, 2021
Python

vene / sparse-structured-attention

Star

Sparse and structured neural attention mechanisms

deep-neural-networks sparsity deep-learning sparse segmentation deeplearning attention-mechanism fused-lasso attention-mechanisms

Updated Aug 31, 2020
Python

jack-willturner / deep-compression

Star

Learning both Weights and Connections for Efficient Neural Networks https://arxiv.org/abs/1506.02626

sparsity deep-learning pytorch pruning

Updated Nov 10, 2022
Jupyter Notebook

lucaslie / torchprune

Star

A research library for pytorch-based neural network pruning, compression, and more.

machine-learning sparsity compression deep-learning pytorch neural-networks pruning tensor-decomposition neural-architecture-search weight-pruning sparsification filter-pruning tinyml generalization-ability coresets pruning-algorithms

Updated Nov 28, 2022
Shell

openvinotoolkit / mmdetection

Star

OpenVINO Training Extensions Object Detection

sparsity compression computer-vision deep-learning pytorch ssd faster-rcnn object-detection instance-segmentation mask-rcnn retinanet onnx openvino cascade-rcnn fcos onnxruntime atss quantization-aware-training nncf

Updated Mar 8, 2023
Python

RAIVNLab / STR

Star

Soft Threshold Weight Reparameterization for Learnable Sparsity

sparsity cnn imagenet str icml efficient-inference soft-thresholding edge-machine-learning sparsity-optimization resource-efficient icml-2020 learnable-sparsity icml2020 soft-threshold-reparameterization

Updated Feb 15, 2023
Python

wenwei202 / iss-rnns

Star

Sparse Recurrent Neural Networks -- Pruning Connections and Hidden Sizes (TensorFlow)

sparsity tensorflow structure recurrent-neural-networks lstm iclr model-compression sparse-lstms

Updated Jul 25, 2020
Python

vene / pyowl

Star

Ordered Weighted L1 regularization for classification and regression in Python

machine-learning sparsity regression classification regularization

Updated Aug 27, 2018
Python

Shiweiliuiiiiiii / In-Time-Over-Parameterization

Star

[ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy

sparsity deep-learning generalization sparse-training over-parameterization overparameterization in-time-overparameterization dynamic-sparse-training in-time-over-parameterization

Updated Dec 28, 2022
Python

sparsity

Here are 101 public repositories matching this topic...

neuralmagic / sparseml

tensorflow / model-optimization

PaddlePaddle / PaddleSlim

intel / neural-compressor

Eric-mingjie / network-slimming

openvinotoolkit / nncf

wenwei202 / caffe

mehtadushy / SelecSLS-Pytorch

IntelLabs / SkimCaffe

The-Learning-And-Vision-Atelier-LAVA / SMSR

bwohlberg / sporco

dcmocanu / sparse-evolutionary-artificial-neural-networks

vene / sparse-structured-attention

jack-willturner / deep-compression

lucaslie / torchprune

openvinotoolkit / mmdetection

RAIVNLab / STR

wenwei202 / iss-rnns

vene / pyowl

Shiweiliuiiiiiii / In-Time-Over-Parameterization

Improve this page

Add this topic to your repo