jasonvanf / llama-trl
LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA
☆205Updated last year
Alternatives and similar repositories for llama-trl:
Users that are interested in llama-trl are comparing it to the libraries listed below
- ☆271Updated 2 months ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆245Updated 6 months ago
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆113Updated last year
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆536Updated 3 months ago
- 🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.☆137Updated 8 months ago
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆313Updated last year
- RewardBench: the first evaluation tool for reward models.☆521Updated 2 weeks ago
- A large-scale, fine-grained, diverse preference dataset (and models).☆331Updated last year
- All available datasets for Instruction Tuning of Large Language Models☆247Updated last year
- Generative Judge for Evaluating Alignment☆230Updated last year
- This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.☆293Updated 7 months ago
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning☆243Updated last year
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆342Updated 6 months ago
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆254Updated last year
- train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism☆215Updated last year
- ☆275Updated last year
- Data and Code for Program of Thoughts (TMLR 2023)☆263Updated 9 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆144Updated 6 months ago
- ☆326Updated last month
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆416Updated 4 months ago
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆241Updated 2 months ago
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark☆371Updated 8 months ago
- RLHF implementation details of OAI's 2019 codebase☆183Updated last year
- A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.☆348Updated last year
- Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning☆393Updated 9 months ago
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆334Updated last year
- Scripts for fine-tuning Llama2 via SFT and DPO.☆195Updated last year
- Direct Preference Optimization from scratch in PyTorch☆87Updated last year
- ☆261Updated 7 months ago
- ☆253Updated last year