#

model-serving

Here are 80 public repositories matching this topic...

BentoML

bentoml / BentoML

Unified Model Serving Framework 🍱

kubernetes machine-learning ai deep-learning aws-lambda tensorflow ml pytorch model-management model-deployment model-serving ml-infrastructure azure-ml mlops aws-sagemaker machine-learning-operations bentoml ml-platform prediction-service

Updated Aug 20, 2022
Python

ahkarami / Deep-Learning-in-Production

In this repository, I will share some useful notes and references about deploying deep learning-based models in production.

Updated Aug 7, 2022

kserve / kserve

Serverless Inferencing on Kubernetes

kubernetes machine-learning tensorflow sklearn pytorch artificial-intelligence xgboost k8s service-mesh istio model-serving kubeflow knative model-interpretability kubeflow-pipelines kserve

Updated Aug 19, 2022
Python

mlrun / mlrun

Machine Learning automation and tracking

python kubernetes workflow data-science machine-learning data-engineering model-serving mlops experiment-tracking mlops-workflow

Updated Aug 20, 2022
Python

logicalclocks / hopsworks

Hopsworks - Data-Intensive AI platform with a Feature Store

python aws data-science machine-learning serverless azure gcp pyspark feature-engineering governance model-serving mlops feature-store feature-management kserve

Updated Aug 19, 2022
Java

bentoml / Yatai

Production-first ML platform on Kubernetes 🦄️

kubernetes model-deployment model-serving mlops bentoml

Updated Aug 19, 2022
TypeScript

underneathall / pinferencia

Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

Updated Aug 18, 2022
Python

eightBEC / fastapi-ml-skeleton

FastAPI Skeleton App to serve machine learning models production-ready.

python machine-learning python3 model-serving fastapi

Updated Jun 22, 2022
Python

lightbend / kafka-with-akka-streams-kafka-streams-tutorial

Code samples for the Lightbend tutorial on writing microservices with Akka Streams, Kafka Streams, and Kafka

akka kafka-streams model-serving

Updated May 30, 2019
Scala

chitra

gradsflow / chitra

A multi-functional library for full-stack Deep Learning. Simplifies Model Building, API development, and Model Deployment.

visualization python machine-learning deep-learning tensorflow image-processing pytorch image-classification image-dataset object-detection hacktoberfest bounding-boxes model-interpretation model-deployment model-serving model-visualization gradcam mlops fastapi

Updated Jun 27, 2022
Python

spotify / zoltar

Common library for serving TensorFlow, XGBoost and scikit-learn models in production.

java machine-learning tensorflow xgboost model-serving

Updated Aug 15, 2022
Java

bentoml / gallery

BentoML Example Projects 🎨

data-science machine-learning gallery aws-lambda serverless machine-learning-library model-management azure-machine-learning model-deployment model-serving machine-learning-workflow gcp-cloud-functions aws-sagemaker bentoml

Updated Aug 4, 2022
Python

FederatedAI / FATE-Serving

A scalable, high-performance serving system for federated learning models

monitor inference model-serving model-versioning federated-learning

Updated Aug 11, 2022
Java

mosec

mosecorg / mosec

A high-performance serving framework for ML models, offers dynamic batching and multi-stage pipeline to fully exploit your compute machine

python machine-learning deep-learning tensorflow gpu pytorch fastcgi hacktoberfest model-serving nerual-network machine-learning-platform mlops

Updated Aug 20, 2022
Python

FlinkML / flink-jpmml

flink-jpmml is a fresh-made library for dynamic real time machine learning predictions built on top of PMML standard models and Apache Flink streaming engine

prediction apache-flink pmml model-serving flink-jpmml

Updated May 9, 2019
Scala

serving-pytorch-models

alvarobartt / serving-pytorch-models

Serving PyTorch models with TorchServe 🔥

machine-learning pytorch image-classification model-deployment model-serving pytorch-cnn mlops torchserve serve-pytorch

Updated Feb 28, 2021
Jupyter Notebook

notAI-tech / fastDeploy

Deploy DL/ ML inference pipelines with minimal extra code.

Updated Jul 19, 2022
JavaScript

lightbend / model-serving-tutorial

Code and presentation for Strata Model Serving tutorial

kafka spark tensorflow akka-streams pmml flink tensorflow-serving model-serving

Updated Sep 26, 2019
Scala

inferencedb

aporia-ai / inferencedb

🚀 Stream inferences of real-time ML models in production to any data lake

machine-learning kafka s3 model-serving mlops model-monitoring

Updated Jun 10, 2022
Python

model_deployment

balavenkatesh3322 / model_deployment

A collection of model deployment library and technique.

aws data-science machine-learning caffe deep-learning neural-network mxnet azure tensorflow model keras pytorch model-deployment model-serving serving serving-recommendation model-server serving-pytorch-models serving-tensors

Updated Jul 22, 2020

Improve this page

Add a description, image, and links to the model-serving topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the model-serving topic, visit your repo's landing page and select "manage topics."