Skip to content
#

tensorrt

Star

Here are 343 public repositories matching this topic...

Language: All
Filter by language
All 343 Python 155 C++ 120 Jupyter Notebook 28 Dockerfile 6 C 4 Shell 3 Go 2 HTML 2 CSS 1 Cuda 1
Sort: Best match
Sort options
Best match Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

Tencent / TNN

Star 3.4k

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.

ocr deep-learning tensorflow inference pytorch tengine face-detection tensorrt mnn coreml ncnn openvino hairsegmentaion
  • Updated Mar 15, 2022
  • C++

666DZY666 / micronet

Star 1.7k

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape

pytorch pruning convolutional-networks quantization xnor-net tensorrt model-compression bnn neuromorphic-computing group-convolution onnx network-in-network tensorrt-int8-python dorefa twn network-slimming integer-arithmetic-only quantization-aware-training post-training-quantization batch-normalization-fuse
  • Updated Oct 6, 2021
  • Python

NVIDIA / Torch-TensorRT

Star 1.3k
Find more good first issues

nebuly-ai / nebullvm

Star 529
Open

Bug in TVM installation (on CPU) for Ubuntu 18.04 systems

morgoth95
morgoth95 commented Mar 2, 2022

The auto-installer fails to install TVM correctly due to llvm not being installed on Ubuntu 18.04 systems. In fact, the command

sudo apt-get install llvm12

fails in Ubuntu 18.04 since llvm12 seems to be not supported. I tested the OS with llvm10 and it seems to work.
So, to solve this issue it should be enough to locate the version of ubuntu and for 18.04 install lllvm10 instead of l

Read more
bug good first issue

Improve this page

Add a description, image, and links to the tensorrt topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the tensorrt topic, visit your repo's landing page and select "manage topics."

Learn more