jackaduma / Alpaca-LoRA-RLHF-PyTorchLinks
A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Alpaca architecture. Basically ChatGPT but with Alpaca
☆60Updated 2 years ago
Alternatives and similar repositories for Alpaca-LoRA-RLHF-PyTorch
Users that are interested in Alpaca-LoRA-RLHF-PyTorch are comparing it to the libraries listed below
Sorting:
- Unofficial implementation of AlpaGasus☆94Updated 2 years ago
- [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.☆156Updated 2 years ago
- Code for ACL2023 paper: Pre-Training to Learn in Context☆106Updated last year
- A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.☆90Updated last year
- a Fine-tuned LLaMA that is Good at Arithmetic Tasks☆178Updated 2 years ago
- ☆173Updated 2 years ago
- Code for "Small Models are Valuable Plug-ins for Large Language Models"☆132Updated 2 years ago
- ☆143Updated 2 years ago
- [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following☆78Updated last year
- ☆98Updated 2 years ago
- 🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.☆138Updated 7 months ago
- Scripts for fine-tuning Llama2 via SFT and DPO.☆206Updated 2 years ago
- the instructions and demonstrations for building a formal logical reasoning capable GLM☆55Updated last year
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆85Updated last year
- Simple next-token-prediction for RLHF☆227Updated 2 years ago
- On Transferability of Prompt Tuning for Natural Language Processing☆100Updated last year
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆221Updated 2 years ago
- ⚡Research papers about leveraging the capabilities of language models⚡☆52Updated 2 years ago
- Source codes and datasets for How well do Large Language Models perform in Arithmetic tasks?☆57Updated 2 years ago
- Code for RL4F: Generating Natural Language Feedback with Reinforcement Learning for Repairing Model Outputs. ACL 2023.☆64Updated last year
- Datasets for Instruction Tuning of Large Language Models☆260Updated 2 years ago
- Code and data for "Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data Curation" (EMNLP 2023)☆65Updated 2 years ago
- Reverse Instructions to generate instruction tuning data with corpus examples☆216Updated last year
- ⏳ ChatLog: Recording and Analysing ChatGPT Across Time☆103Updated last year
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆149Updated last year
- Self-Alignment with Principle-Following Reward Models☆169Updated 3 months ago
- A dataset for training/evaluating Question Answering Retrieval models on ChatGPT responses with the possibility to training/evaluating on…☆141Updated last year
- Scripts for generating synthetic finetuning data for reducing sycophancy.☆117Updated 2 years ago
- Plug in and play implementation of " Textbooks Are All You Need", ready for training, inference, and dataset generation☆74Updated 2 years ago
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆283Updated 2 years ago