#

peft

Here are 36 public repositories matching this topic...

mymusise / ChatGLM-Tuning

一种平价的chatgpt实现方案, 基于ChatGLM-6B + LoRA

lora peft chatgpt chatglm

Updated Jun 19, 2023
Python

hiyouga / ChatGLM-Efficient-Tuning

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

transformers pytorch lora language-model alpaca fine-tuning peft huggingface chatgpt rlhf chatglm qlora chatglm2

Updated Jul 28, 2023
Python

hiyouga / LLaMA-Efficient-Tuning

Easy-to-use fine-tuning framework using PEFT (PT+SFT+RLHF with QLoRA) (LLaMA-2, BLOOM, Falcon, Baichuan)

bloom transformers falcon llama quantization language-model fine-tuning peft pre-training llm rlhf qlora baichuan-7b llama2

Updated Jul 28, 2023
Python

lxe / simple-llm-finetuner

Simple UI for LLM Model Finetuning

ai pytorch llama peft gpt-2 huggingface huggingface-transformers gpt-3 llm

Updated Apr 23, 2023
Jupyter Notebook

yangjianxin1 / Firefly

Firefly(流萤): 中文对话式大语言模型(全量微调+QLoRA)，支持微调Llma2、Llama、Baichuan、InternLM、Ziya、Bloom等大模型

bloom llama gpt lora alpaca peft baichuan llm instruction-tuning qlora baichuan-7b internlm baichuan-13b llama2 llama-2

Updated Jul 28, 2023
Python

jianzhnie / Efficient-Tuning-LLMs

Easy and Efficient Finetuning of QLoRA LLMs. (Supported LLama, LLama2, bloom, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.

bloom llama glm lora peft llms baichuan-7b baichuan-13b

Updated Jul 28, 2023
Python

LLaMA-LoRA-Tuner

zetavg / LLaMA-LoRA-Tuner

UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.

machine-learning ai llama gpt lora language-model alpaca peft google-colab gpt-j alpaca-lora

Updated May 29, 2023
Python

jackaduma / Vicuna-LoRA-RLHF-PyTorch

A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Vicuna architecture. Basically ChatGPT but with Vicuna

pytorch llama gpt lora finetune ppo peft vicuna llm chatgpt rlhf reward-models vicuna-7b

Updated Apr 28, 2023
Python

jianzhnie / open-chatgpt

The open source implementation of ChatGPT, Alpaca, Vicuna and RLHF Pipeline. 从0开始实现一个ChatGPT.

llama gpt lora ppo peft llm chatgpt rlhf stanford-alpaca

Updated Jun 1, 2023
Python

Guitaricet / relora

Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates

nlp deep-learning transformer llama distributed-training peft

Updated Jul 28, 2023
Jupyter Notebook

jackaduma / ChatGLM-LoRA-RLHF-PyTorch

A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM

pytorch llama gpt lora finetune ppo peft deepspeed llm chatgpt rlhf reward-models chatglm chatglm-6b

Updated Apr 28, 2023
Python

jasonvanf / llama-trl

LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA

adapter transformer llama gpt lora ppo peft trl gpt-4 chatgpt rlhf

Updated May 23, 2023
Python

jackaduma / Alpaca-LoRA-RLHF-PyTorch

A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Alpaca architecture. Basically ChatGPT but with Alpaca

pytorch llama gpt lora alpaca finetune ppo peft deepspeed llm chatgpt rlhf reward-models

Updated Apr 28, 2023
Python

Reason-Wang / flan-alpaca-lora

This repository contains the code to train flan t5 with alpaca instructions and low rank adaptation.

pytorch lora alpaca peft low-rank huggingface t5 instruction-tuning flan-t5

Updated Jun 17, 2023
Python

sharma-n / DAG_Scheduling

HEFT, randomHEFT and IPEFT algorithms for static list DAG Scheduling

dag scheduling-algorithms directed-acyclic-graph peft heft ipeft dag-scheduling

Updated Oct 13, 2019
Jupyter Notebook

sanjibnarzary / awesome-llm

Curated list of open source and openly accessible large language models

Updated Jul 16, 2023

NisaarAgharia / Indian-LawyerGPT

Fine-Tuning Falcon-7B, LLAMA 2 with QLoRA to create an advanced AI model with a profound understanding of the Indian legal context.

falcon llama gpt fine-tuning peft huggingface-transformers large-language-models llms qlora llama2

Updated Jul 27, 2023
Jupyter Notebook

LeVuMinhHuy / brocode

an AI bro who coding algorithm with you

algorithm algorithms transformer code-generation lora peft code-summarization huggingface

Updated Jul 25, 2023
TypeScript

danielgrittner / nanoGPT-LoRA

The simplest, fastest repository for training/finetuning medium-sized GPTs with LoRA support.

deep-learning transformers gpt lora peft gpt-2 llm

Updated May 1, 2023
Python

tic-top / LoraCSE

😜Constrative Learning of Sentence Embedding using LoRA (EECS487 final project)

nlp pytorch lora sentence-embeddings peft contrastive-learning

Updated Apr 19, 2023
Jupyter Notebook

Improve this page

Add a description, image, and links to the peft topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the peft topic, visit your repo's landing page and select "manage topics."