jasonvanf / llama-trl
LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA
☆206Updated last year
Alternatives and similar repositories for llama-trl:
Users that are interested in llama-trl are comparing it to the libraries listed below
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆251Updated 6 months ago
- ☆271Updated 2 months ago
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆114Updated last year
- 🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.☆137Updated 9 months ago
- Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning☆393Updated 10 months ago
- A large-scale, fine-grained, diverse preference dataset (and models).☆335Updated last year
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆316Updated last year
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆542Updated 3 months ago
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆347Updated 6 months ago
- All available datasets for Instruction Tuning of Large Language Models☆247Updated last year
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning☆246Updated last year
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆147Updated 6 months ago
- Generative Judge for Evaluating Alignment☆230Updated last year
- ☆325Updated last month
- Implements pre-training, supervised fine-tuning (SFT), and reinforcement learning from human feedback (RLHF), to train and fine-tune the …☆48Updated last year
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆424Updated 5 months ago
- [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627☆478Updated 5 months ago
- This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.☆299Updated 7 months ago
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆247Updated 3 months ago
- Scripts for fine-tuning Llama2 via SFT and DPO.☆195Updated last year
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them☆471Updated 9 months ago
- ☆277Updated last year
- Unofficial implementation of AlpaGasus☆90Updated last year
- RLHF implementation details of OAI's 2019 codebase☆183Updated last year
- ☆253Updated last year
- [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models☆98Updated 3 months ago
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…☆119Updated 9 months ago
- Data and Code for Program of Thoughts (TMLR 2023)☆264Updated 10 months ago
- [EMNLP 2023] Adapting Language Models to Compress Long Contexts☆296Updated 6 months ago
- Open Source WizardCoder Dataset☆157Updated last year