Build software better, together

🍅A lite C++ toolkit of awesome AI models with ONNXRuntime, NCNN, MNN and TNN. YOLOX, YOLOP, YOLOv5, YOLOR, NanoDet, YOLOX, SCRFD, YOLOX. MNN, NCNN, TNN, ONNXRuntime, CPU/GPU ...

Updated Dec 27, 2021
C++

emilianavt / OpenSeeFace

Star

Robust realtime face and facial landmark tracking on CPU with Unity integration

Updated Nov 10, 2021
Python

ELS-RD / transformer-deploy

Star

Efficient, scalable and enterprise-grade CPU/GPU inference server for Hugging Face transformer models 🚀

inference pytorch tensorrt onnxruntime triton-inference-server

Updated Dec 28, 2021
Python

open-mmlab / mmdeploy

Star

OpenMMLab Model Deployment Framework

sdk deployment tensorrt ncnn model-converter openvino onnxruntime pplnn

Updated Dec 29, 2021
C++

zhiqwang / yolov5-rt-stack

Star

Open

Reduce dependencies for inferencing only

zhiqwang commented Oct 28, 2021

🚀 The feature

In version 0.5.x we have full support for YOLOv5, at the cost of introducing more dependencies. If someone just wants to use the models for inference, he/she doesn't need all additional features like:

visualizations
profiling
type conversions to pandas
...

However, those useful features are (pa

Add a dataloader as ultralytics in detection pipeline

5

Open

Pretrained model of the DarkNet Backbone

Find more good first issues

Ki6an / fastT5

Star

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

python nlp fast translation question-answering quantization onnx t5 onnxruntime fastt5 quantized-onnx-models inference-speed

Updated Dec 23, 2021
Python

abelriboulot / onnxt5

Star

Open

Implement beam search

2

abelriboulot commented Aug 2, 2020

A next step for better generation is to implement a beam search for the generation. An example of it can be seen on the huggingface repo here, and this would need adding such a function to the GenerativeT5 model in onnxt5/models.py

ppogg / YOLO-Streaming

Star

Push-pull streaming and Web display of YOLO series

flask web stream dnn yolov3 onnxruntime yolov4 yolov5 yolox

Updated Aug 1, 2021
Python

patil-suraj / onnx_transformers

Star

Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.

nlp transformers inference onnx onnxruntime

Updated Dec 5, 2020
Jupyter Notebook

tenglike1997 / onnxruntime-projects

Star

Code for some onnxruntime projects

c-plus-plus onnx onnxruntime

Updated Apr 26, 2021
C++

nbigaouette / onnxruntime-rs

Star

Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

rust inference rust-wrapper onnx onnxruntime onnx-runtime onnxruntime-sys

Updated Nov 2, 2021
Rust

xmba15 / onnx_runtime_cpp

Star

small c++ library to quickly deploy models using onnxruntime

cpp face-detection mask-rcnn onnx yolov3 tiny-yolov2 onnxruntime onnx-cpp mask-rcnn-cpp

Updated Sep 5, 2021
C++

Rapternmn / PyTorch-Onnx-Tensorrt

Star

A set of tool which would make your life easier with Tensorrt and Onnxruntime. This Repo is designed for YoloV3

pytorch darknet tensorrt onnx onnx-torch yolov3 inference-optimization onnxruntime

Updated Dec 31, 2019
Python

openvinotoolkit / mmdetection

Star

OpenVINO Training Extensions Object Detection

sparsity compression computer-vision deep-learning pytorch ssd faster-rcnn object-detection instance-segmentation mask-rcnn retinanet onnx openvino cascade-rcnn fcos onnxruntime atss quantization-aware-training nncf

Updated Dec 28, 2021
Python

RidgeRun / gst-inference

Star

A GStreamer Deep Learning Inference Framework

machine-learning deep-learning gstreamer tensorflow inference artificial-intelligence gst tensorrt onnx movidius ncsdk onnxruntime

Updated Dec 1, 2021
C

ibaiGorordo / ONNX-Mobile-Human-Pose-3D

Sponsor

Star

Python scripts for performing 3D human pose estimation using the Mobile Human Pose model in ONNX.

pose-estimation onnx 3d-pose-estimation onnxruntime yolov5s

Updated Sep 27, 2021
Python

dsindex / iclassifier

Star

reference pytorch code for intent classification

optimization transformers cnn pytorch densenet pruning glove sentence-classification quantization sst bert snips dsa intent-classification onnx onnxruntime

Updated Dec 7, 2021
Python

ppogg / onnx-scrfd-flask

Star

onnx+onnxruntime+scrfd+flask+web

flask web face onnxruntime scrfd

Updated Jun 24, 2021
Python

itsnine / yolov5-onnxruntime

Star

YOLOv5 ONNX Runtime C++ inference code.

opencv deployment object-detection onnx onnxruntime yolov5

Updated Dec 21, 2021
C++

DefTruth / RobustVideoMatting.lite.ai.toolkit

Star

🍅

🍅 RobustVideoMatting with ONNXRunttime/MNN/NCNN/TNN C++(https://github.com/DefTruth/lite.ai.toolkit)

cpp matting mnn ncnn onnx onnxruntime tnn robustvideomatting

Updated Dec 18, 2021
C++

openvinotoolkit / deep-object-reid

Star

OpenVINO Training Extensions Object Re-identification

deep-neural-networks computer-vision deep-learning pytorch onnx reid person-reid openvino vehicle-reid onnxruntime osnet

Updated Dec 28, 2021
Python

ibaiGorordo / onnx-Ultra-Fast-Lane-Detection-Inference

Sponsor

Star

Example scripts for the detection of lanes using the ultra fast lane detection model in ONNX.

lane-detection lane-lines-detection onnx lane-segmentation onnxruntime

Updated Dec 24, 2021
Python

BlueMirrors / cvu

Star

Computer Vision deployment tools for dummies and experts. CVU aims at making CV pipelines easier to build and consistent around platforms, devices, and models.

computer-vision pytorch object-detection tensorrt tensorflow2 onnxruntime yolov5

Updated Sep 6, 2021
Python

chiehpower / Setup-deeplearning-tools

Star

Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ NVIDIA-docker on AGX or PC from scratch.

docker deep-learning ci agx cuda pytorch nvidia tesseract-ocr installation cudnn tensorrt onnxruntime tensorrt-inference-server onnx2trt onnx-simplifier triton-inference-server triton-server

Updated Dec 22, 2021
Starlark

zhiqwang / demonet

Star

Yet another ssd, with its runtime stack for libtorch, onnx and specialized accelerators.

ssd object-detection onnx mobilenet-ssd libtorch onnxruntime torchscript demonet

Updated May 31, 2021
Python

tuyuai / TuYuIDCard

Star

准确率99%的跨平台身份证识别

macos linux win idcard east crnn onnxruntime

Updated Aug 17, 2021
C++

s1ddok / Sardonyx

Star

Convert your ONNX models into Swift for TensorFlow or Metal Performance Shaders (WIP)

swift machine-learning metal ml code-generation metalperformanceshaders onnx swift-for-tensorflow s4tf onnxruntime onnx-models

Updated Aug 5, 2020
Swift

davidmallasen / LiveChess2FEN

Star

Predict live chess games into FEN notation.

chess computer-vision deep-learning fen chessboard convolutional-neural-networks tensorrt onnx chessboard-recognition chessboard-detection nvidia-jetson-nano onnxruntime

Updated Oct 2, 2021
Python

onnxruntime

Here are 109 public repositories matching this topic...

deepjavalibrary / djl

Yolo Model

Description

References

Stanford Question Answering Dataset

Penn Tree Bank Dataset

RedisAI / RedisAI

DefTruth / lite.ai.toolkit

emilianavt / OpenSeeFace

ELS-RD / transformer-deploy

open-mmlab / mmdeploy

zhiqwang / yolov5-rt-stack

Reduce dependencies for inferencing only

🚀 The feature

Add a dataloader as ultralytics in detection pipeline

Pretrained model of the DarkNet Backbone

Ki6an / fastT5

abelriboulot / onnxt5

Implement beam search

ppogg / YOLO-Streaming

patil-suraj / onnx_transformers

tenglike1997 / onnxruntime-projects

nbigaouette / onnxruntime-rs

xmba15 / onnx_runtime_cpp

Rapternmn / PyTorch-Onnx-Tensorrt

openvinotoolkit / mmdetection

RidgeRun / gst-inference

ibaiGorordo / ONNX-Mobile-Human-Pose-3D

dsindex / iclassifier

ppogg / onnx-scrfd-flask

itsnine / yolov5-onnxruntime

DefTruth / RobustVideoMatting.lite.ai.toolkit

openvinotoolkit / deep-object-reid

ibaiGorordo / onnx-Ultra-Fast-Lane-Detection-Inference

BlueMirrors / cvu

chiehpower / Setup-deeplearning-tools

zhiqwang / demonet

tuyuai / TuYuIDCard

s1ddok / Sardonyx

davidmallasen / LiveChess2FEN

Improve this page

Add this topic to your repo