#
serving
Here are 53 public repositories matching this topic...
A flexible, high-performance serving system for machine learning models
-
Updated
Sep 13, 2020 - C++
neuhausler
commented
Jun 9, 2020
PrestoDB https://prestodb.io .. is widely used as SQL frontend for many different data-sources, including ElasticSearch, and even files in S3 .. would be very nice if there would be a Connector available for Vespa.
In this repository, I will share some useful notes and references about deploying deep learning-based models in production.
react
python
angularjs
flask
c-plus-plus
tutorial
deep-neural-networks
deep-learning
mxnet
rest-api
production
keras
pytorch
tensorflow-models
tesnorflow
model-serving
caffe2
serving
serving-pytorch-models
convert-pytorch-models
-
Updated
Sep 11, 2020
TensorFlow template application for deep learning
machine-learning
csv
deep-learning
tensorflow
inference
cnn
lstm
tensorboard
mlp
libsvm
tfrecords
wide-and-deep
serving
-
Updated
Jan 3, 2019 - Python
RafalSkolasinski
commented
Jul 27, 2020
Sub issue for SeldonIO/seldon-core#2012
We should have a good documentation on selcon-core-microservice from usage perspective:
- CLI arguments
- Environmental Variables
- etc...
DELTA is a deep learning based natural language and speech processing platform.
nlp
front-end
ops
deep-learning
text-classification
tensorflow
nlu
speech
inference
text-generation
speech-recognition
seq2seq
sequence-to-sequence
speaker-verification
asr
tensorflow-serving
emotion-recognition
custom-ops
serving
tensorflow-lite
-
Updated
Sep 7, 2020 - Python
Generic and easy-to-use serving service for machine learning models
-
Updated
Mar 9, 2020 - JavaScript
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
python
docker
deep-learning
pipeline
gpu
prediction
micro-service
rpc-service
dag
paddle
microservice-toolkit
predictor
serving
online-service
paddle-serving
-
Updated
Sep 9, 2020 - C++
Machine Learning Serving cluster
-
Updated
Sep 13, 2020 - Smarty
MLModelCI is a complete platform for managing, converting, profiling, and deploying models as cloud services (MLaaS)
docker
machine-learning
cloud
deep-learning
multimedia
continuous-integration
profiler
inference
dispatcher
cloud-service
housekeeper
serving
mlaas
convert-models
-
Updated
Sep 4, 2020 - Python
A stand alone industrial serving system for angel.
-
Updated
May 13, 2020 - Java
Knativeのコンポーネントを理解しながらFaaSプラットフォームをDIYするワークショップです
go
kubernetes
golang
serverless
pubsub
eventing
gke
gcr
watchdog
tm
serving
knative
tekton
knative-lambda-runtimes
-
Updated
Jan 1, 2020
This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.
machine-learning
spark
pipeline
sparkml
inference
serving
sagemaker
mleap
inference-pipeline
mleap-serialized-spark
-
Updated
Aug 12, 2020 - Java
Meme serving with NLP
-
Updated
Dec 23, 2019 - Python
TensorFlow Serving ARM - A project for cross-compiling TensorFlow Serving targeting popular ARM cores
-
Updated
Aug 17, 2020 - Starlark
Reasonable API for serving TensorFlow models using Scala
-
Updated
Nov 2, 2017 - Scala
Deploy DL/ ML inference pipelines with minimal extra code.
docker
deep-learning
gunicorn
pytorch
falcon
http-server
gevent
tensorflow-serving
model-deployment
model-serving
serving
tf-serving
torchserve
-
Updated
Aug 7, 2020 - Python
A collection of model deployment library and technique.
aws
data-science
machine-learning
caffe
deep-learning
neural-network
mxnet
azure
tensorflow
model
keras
pytorch
model-deployment
model-serving
serving
serving-recommendation
model-server
serving-pytorch-models
serving-tensors
-
Updated
Jul 22, 2020
AsyncIO serving for data science models
python
http
data-science
machine-learning
async
rest-api
scikit-learn
pandas
pytorch
dataframe
serving
-
Updated
May 4, 2020 - Python
pytorch during training, libtorch during serving via gRPC
-
Updated
Sep 9, 2019 - C++
Client for TensorFlow Serving
-
Updated
Mar 27, 2018 - Python
Serve your fastText models for text classification and word embeddings
-
Updated
Feb 7, 2020 - Python
call tensorflow serving from any php application
-
Updated
Apr 21, 2018 - PHP
Exposes a serialized machine learning model through a HTTP API.
-
Updated
Jul 3, 2020 - Java
Custom Mask R-CNN matterport's model with tensorflow serving
tensorflow
rest-api
grpc
tensorflow-serving
mask-rcnn
serving
matterport
tensorflow-serving-api
tensorflow-serving-rest-api
tensorflow-serving-grpc
-
Updated
Aug 27, 2019 - Python
Merging Models for TensorFlow Serving
python
deep-learning
tensorflow
tensorflow-models
tensorflow-serving
grpc-server
serving
tensorflow-graph
tensorflow-solutions
savedmodel
-
Updated
Sep 15, 2018 - Python
Improve this page
Add a description, image, and links to the serving topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the serving topic, visit your repo's landing page and select "manage topics."
I often run into issues by accidentally starting a new cluster when one is already running. Then, this later causes problems when I try to connect and there are two running clusters. I'm then forced to
ray stopboth clusters andray startmy new one again.My workflow would be improved if I just got an error when trying to start the second cluster and knew to immediately tear down the exist