language-model

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

Code and documentation to train Stanford's Alpaca models, and generate the data.

🔍 Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-4, ChatGPT and alike). Haystack offers production-ready tools to quickly build complex decision making, question answering, semantic search, text generation applications, and more.

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

NeMo: a toolkit for conversational AI

ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

A PyTorch-based Speech Toolkit

Google AI 2018 BERT pytorch implementation

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Model for All.

An open source implementation of CLIP.

Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.

decentralising the Ai Industry, free gpt-4/3.5 scripts through several reverse engineered api's ( poe.com, phind.com, chat.openai.com, phind.com, writesonic.com, sqlchat.ai, t3nsor.com, you.com etc...)

Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard