Alternatives and similar repositories for reward-bench

Users that are interested in reward-bench are comparing it to the libraries listed below

• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆888Updated this week
• OpenBMB / UltraFeedback
  A large-scale, fine-grained, diverse preference dataset (and models).
  ☆353Updated last year
• glgh / awesome-llm-human-preference-datasets
  A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.
  ☆378Updated last year
• voidism / DoLa
  Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"
  ☆516Updated 8 months ago
• princeton-nlp / LESS
  [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning
  ☆496Updated 11 months ago
• MARIO-Math-Reasoning / Super_MARIO
  ☆340Updated 3 months ago
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆472Updated 2 weeks ago
• huggingface / Math-Verify
  ☆948Updated 3 months ago
• THUDM / ReST-MCTS
  ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)
  ☆668Updated 8 months ago
• teacherpeterpan / self-correction-llm-papers
  This is a collection of research papers for Self-Correcting Large Language Models with Automated Feedback.
  ☆547Updated 11 months ago
• princeton-nlp / SimPO
  [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward
  ☆923Updated 7 months ago
• ezelikman / STaR
  Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)
  ☆210Updated 2 years ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆250Updated 2 months ago
• YuxiXie / MCTS-DPO
  This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.
  ☆325Updated last year
• ZubinGou / math-evaluation-harness
  A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨
  ☆257Updated last year
• sangmichaelxie / doremi
  Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets
  ☆341Updated last year
• eddycmu / demystify-long-cot
  ☆318Updated 4 months ago
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆362Updated last year
• waterhorse1 / LLM_Tree_Search
  (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training
  ☆280Updated last year
• QwenLM / AutoIF
  ☆307Updated last year
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆360Updated last year
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆473Updated last year
• xfactlab / orpo
  Official repository for ORPO
  ☆464Updated last year
• suzgunmirac / BIG-Bench-Hard
  Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
  ☆515Updated last year
• hkust-nlp / AgentBoard
  An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]
  ☆354Updated last year
• kanishkg / cognitive-behaviors
  ☆207Updated 6 months ago
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆434Updated last year
• allenai / FineGrainedRLHF
  ☆280Updated 8 months ago
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆533Updated 3 months ago
• likenneth / honest_llama
  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
  ☆549Updated 8 months ago