HumanSignal / RLHF
Collection of links, tutorials and best practices of how to collect the data and build end-to-end RLHF system to finetune Generative AI models
☆216Updated last year
Alternatives and similar repositories for RLHF:
Users that are interested in RLHF are comparing it to the libraries listed below
- Notes and commented code for RLHF (PPO)☆77Updated last year
- Official repository for ORPO☆446Updated 9 months ago
- A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.☆350Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆73Updated 5 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆105Updated 6 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆253Updated 8 months ago
- experiments with inference on llama☆104Updated 9 months ago
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆102Updated this week
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆819Updated this week
- Generative Representational Instruction Tuning☆612Updated 2 weeks ago
- Reward Model framework for LLM RLHF☆61Updated last year
- ☆277Updated last year
- Let's build better datasets, together!☆257Updated 3 months ago
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆254Updated last year
- Benchmarking library for RAG☆181Updated last week
- Scripts for fine-tuning Llama2 via SFT and DPO.☆195Updated last year
- An extensible benchmark for evaluating large language models on planning☆331Updated last week
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆501Updated 9 months ago
- LLM Workshop by Sourab Mangrulkar☆369Updated 9 months ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆349Updated 6 months ago
- ☆502Updated 4 months ago
- awesome synthetic (text) datasets☆265Updated 4 months ago
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆255Updated last year
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆334Updated last year
- ☆119Updated 5 months ago
- RewardBench: the first evaluation tool for reward models.☆532Updated last month
- Welcome to the LLMs Interview Prep Guide! This GitHub repository offers a curated set of interview questions and answers tailored for Dat…☆128Updated last year
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆454Updated last year
- Starter pack for NeurIPS LLM Efficiency Challenge 2023.☆124Updated last year
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆126Updated last year