A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Vicuna architecture. Basically ChatGPT but with Vicuna
☆219May 20, 2024Updated 2 years ago
Alternatives and similar repositories for Vicuna-LoRA-RLHF-PyTorch
Users that are interested in Vicuna-LoRA-RLHF-PyTorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human…☆60Apr 28, 2023Updated 3 years ago
- A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Huma…☆138Apr 28, 2023Updated 3 years ago
- LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA☆238Aug 17, 2025Updated last year
- llama fine-tuning with lora☆140May 8, 2024Updated 2 years ago
- Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca☆4,105Apr 18, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 用RLHF可选LoRA对LLaMA和MOSS进行训练|Training LLaMA or MOSS with RLHF [LoRA]☆21May 16, 2023Updated 3 years ago
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆117Jun 5, 2023Updated 3 years ago
- moss chat finetuning☆51Apr 23, 2024Updated 2 years ago
- Mistral and Mixtral (MoE) from scratch☆10May 27, 2024Updated 2 years ago
- 对ChatGLM直接使用RLHF提升或降低目标输出概率|Modify ChatGLM output with only RLHF☆195May 23, 2023Updated 3 years ago
- We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…☆2,787Dec 12, 2023Updated 2 years ago
- Instruct-tune LLaMA on consumer hardware☆18,889Jul 29, 2024Updated 2 years ago
- Math-OCR-Zero: A high-quality mathematical dataset for reinforcement learning in multimodal large models☆12Mar 30, 2026Updated 7 months ago
- llama2 finetuning with deepspeed and lora☆176Jul 28, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Reward Model framework for LLM RLHF☆63Jun 7, 2023Updated 3 years ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,549May 1, 2026Updated 6 months ago
- 4 bits quantization of LLaMA using GPTQ☆3,069Jul 13, 2024Updated 2 years ago
- nlp_interview notes and answers: 该仓库主要记录 NLP 算法工程师相关的面试题和参考答案☆24Nov 16, 2023Updated 2 years ago
- Reinforcement Learning for Uplift Modeling☆13Mar 13, 2021Updated 5 years ago
- 探索中文instruct数据在ChatGLM, LLaMA上的微调表现☆385Apr 4, 2023Updated 3 years ago
- A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆4,755Jan 8, 2024Updated 2 years ago
- ☆122Apr 21, 2023Updated 3 years ago
- ☆26May 21, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A (somewhat) minimal library for finetuning language models with PPO on human feedback.☆91Nov 23, 2022Updated 3 years ago
- chatglm多gpu用deepspeed和☆409Jul 8, 2024Updated 2 years ago
- ☆17Jun 1, 2022Updated 4 years ago
- A curated list of reinforcement learning with human feedback resources (continually updated)☆4,439May 20, 2026Updated 5 months ago
- 2023 ABCI Llama-2 継続学習プロジェクト☆14Jan 22, 2024Updated 2 years ago
- 用户地理位置的聚类算法实现—基于DBSCAN和Kmeans的混合算法☆26Feb 17, 2019Updated 7 years ago
- Explains Canadian Bills☆17May 13, 2023Updated 3 years ago
- Example models using DeepSpeed☆6,848Sep 30, 2026Updated last month
- Let ChatGPT teach your own chatbot in hours with a single GPU!☆3,142Mar 17, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- chatglm_rlhf_finetuning☆30Oct 10, 2023Updated 3 years ago
- Training and Inference Notebooks for the RedPajama (OpenLlama) models☆19May 18, 2023Updated 3 years ago
- 骆驼:A Chinese finetuned instruction LLaMA. Developed by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子昂 @ 商汤科技☆713May 30, 2023Updated 3 years ago
- Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback☆1,621Nov 24, 2025Updated 11 months ago
- 骆驼(Luotuo): Open Sourced Chinese Language Models. Developed by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子昂 @ 商汤科技☆3,578Sep 3, 2023Updated 3 years ago
- Instruction Tuning with GPT-4☆4,332Jun 11, 2023Updated 3 years ago
- UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT…☆472May 29, 2023Updated 3 years ago