transformers

🧑‍🏫 59 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

CVPR 2023 论文和开源项目合集

👑 Easy-to-use and powerful NLP library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis and 🖼 Diffusion AIGC system etc.

🔍 Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-4, ChatGPT and alike). Haystack offers production-ready tools to quickly build complex question answering, semantic search, text generation applications, and more.

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

The next-generation platform to monitor and optimize your AI costs in one place 🚀

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

A PyTorch-based Speech Toolkit

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

This repository contains demos I made with the Transformers library by HuggingFace.

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

Tutorials on getting started with PyTorch and TorchText for sentiment analysis.

Transformers for Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI