TensorChord
- modelz
- Modelz is a developer-first platform for prototyping and deploying machine learning models.
- envd
- envd (ɪnˈvdɪ) is a command-line tool that helps you create the container-based development environment for AI/ML.
- mosec
- Mosec is a high-performance and flexible model serving framework for building ML model-enabled backend and microservices.
- Modelz-LLM
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
- pgvecto.rs
- pgvecto.rs is a Postgres extension that provides vector similarity search functions. It is written in Rust and based on pgrx.
- Awesome-LLMOps
- An awesome & curated list of best LLMOps tools for developers
