jackaduma / Alpaca-LoRA-RLHF-PyTorchLinks
A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Alpaca architecture. Basically ChatGPT but with Alpaca
☆60Updated 2 years ago
Alternatives and similar repositories for Alpaca-LoRA-RLHF-PyTorch
Users that are interested in Alpaca-LoRA-RLHF-PyTorch are comparing it to the libraries listed below
Sorting:
- Code for ACL2023 paper: Pre-Training to Learn in Context☆107Updated last year
- A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.☆87Updated last year
- [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following☆78Updated last year
- Unofficial implementation of AlpaGasus☆93Updated 2 years ago
- ☆98Updated 2 years ago
- ☆140Updated 2 years ago
- Code and data for "Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data Curation" (EMNLP 2023)☆64Updated last year
- Code for "Small Models are Valuable Plug-ins for Large Language Models"☆131Updated 2 years ago
- 🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.☆139Updated 5 months ago
- ⚡Research papers about leveraging the capabilities of language models⚡☆52Updated 2 years ago
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆217Updated 2 years ago
- On Transferability of Prompt Tuning for Natural Language Processing☆100Updated last year
- ☆95Updated last year
- [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.☆153Updated last year
- Datasets for Instruction Tuning of Large Language Models☆257Updated last year
- [ICLR 2023] Codebase for Copy-Generator model, including an implementation of kNN-LM☆188Updated 8 months ago
- PERFECT: Prompt-free and Efficient Few-shot Learning with Language Models☆108Updated 3 years ago
- ☆35Updated 2 years ago
- ☆74Updated last year
- A framework for human-readable prompt-based method with large language models. Specially designed for researchers. (Deprecated, check out…☆131Updated 2 years ago
- a Fine-tuned LLaMA that is Good at Arithmetic Tasks☆177Updated 2 years ago
- Contrastive Chain-of-Thought Prompting☆68Updated last year
- Source code for the paper "Active Prompting with Chain-of-Thought for Large Language Models"☆245Updated last year
- Self-Alignment with Principle-Following Reward Models☆165Updated 3 weeks ago
- ☆173Updated 2 years ago
- Scripts for fine-tuning Llama2 via SFT and DPO.☆203Updated 2 years ago
- Prompt tuning for GPT-J☆67Updated 2 years ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆148Updated 11 months ago
- A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human…☆219Updated last year
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆82Updated last year