🔮 Multimodal AI services & pipelines with cloud-native stack: gRPC, Kubernetes, Docker, OpenTelemetry, Prometheus, Jaeger, etc.

MindsDB is a Server for Artificial Intelligence Logic. Enabling developers to ship to production AI powered projects (from the latest LLMs, vector operations, state of the art time-series forecasting to Machine Learning) in a fast and scalable way.

<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

Build Production-Grade AI Applications

Operating LLMs in production

A high-throughput and memory-efficient inference and serving engine for LLMs

AGiXT is a dynamic AI Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

🏕️ Reproducible development environment for AI/ML

Your open-source LLM experimentation, response validation and monitoring toolkit.

ML Observability in a Notebook - Uncover Insights, Surface Problems, Monitor, and Fine Tune your Generative LLM, CV and Tabular Models

An awesome & curated list of best LLMOps tools for developers

The testing framework dedicated to ML models, from tabular to LLMs 🛡️🧑‍🔬

An open-source visual programming environment for battle-testing prompts to LLMs.

FastAPI framework to build production-grade LLM applications

🧠 Motorhead is a memory and information retrieval server for LLMs.

Ray Aviary - evaluate multiple LLMs easily

Rebuff.ai - Prompt Injection Detector

Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality.

Evaluation and Tracking for LLM Experiments

Prem provides a unified environment to develop AI applications and deploy AI models on your infrastructure