serving

Description

In many other great docs sites, like https://www.tensorflow.org/api_docs, there's a button at the end of the page to collect simple feedback.

This will help us more accurately improve our docs

Use cas

... to make it easier to read Vespa documentation on an e-reader / offline

Vespa documentation is generated using Jekyll from .md and .html files, look into options for generating the artifact as part of site generation (there might be plugins we can use here)

The documentation for creating complex inference graphs should include what components can be connected to what, and how the overall graph should behave.

For example, all inference graphs need to end with a single node, whether its a combiner combining multiple inputs, or a transformer, or a model--the graph can't split and then never rejoin, etc.

🚀 The feature

As far as I know, there are no examples or documentation on serving Speech2Text models from Huggingface, such as Wav2Vec2. How could I enable serving with Wav2Vec2 Huggingface pre-trained checkpoints ?

Motivation, pitch

I'm working on Huggingface Wav2Vec2 models' deployment, and would like serving on these models made possible. Thank you !

Alternatives

No response

NVIDIA-DOCKER 部署paddleserving的ocr服务，没有问题。
但是在私有BML上部署的时候，服务调用不了。请问是不是gpu虚拟卡的问题。

The format of current master branch UDF output, eva-reuse and my SSD object detector is different. Need a sync format.