A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device.

llama.go is like llama.cpp in pure Golang!

Extending Hugging Face transformers APIs for Transformer-based models and improve the productivity of inference deployment. With extremely compressed models, the toolkit can greatly improve the inference efficiency on Intel platforms.

Build AI applications, chatbots, and agents with JavaScript and TypeScript.

Self-evaluating interview for AI coders

UI for 🦙model . Run AI assistant locally ✨

This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.

Building applications with LLMs through composability, in Kotlin, Scala, ...

Langport is a language model inference service

LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.

BabyAGI-🦙: Enhanced for Llama models (running 100% local) and persistent memory, with smart internet search based on BabyCatAGI and document embedding in langchain based on privateGPT

InsightSolver: Colab notebooks for exploring and solving operational issues using deep learning, machine learning, and related models.

Making offline AI models accessible to all types of edge devices.

Simplify and accelerate AI-powered application development with structured interfaces to models and powerful prompt execution environments.

Run LLMs locally. A clojure wrapper for llama.cpp.

LLaMAZoo - Platform for serving LLaMA models on your PC / Mac

Python bindings to llama.cpp

Your customized AI characters - personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.

Wrapper around llama-cpp-python for chat completion with LLaMA v2 models.

A simple to use and powerful web-interface to mess around with Meta's LLaMA LLM.