Alternatives and similar repositories for PrefPalette

Users that are interested in PrefPalette are comparing it to the libraries listed below

• DualityRL / multi-attempt
  ☆19Updated 8 months ago
• bryanchrist / MathNeuro
  Codebase for Math Neurosurgery: Isolating LLMs' Math Reasoning Abilities Using Only Forward Passes
  ☆20Updated 5 months ago
• facebookresearch / AbstentionBench
  A holistic benchmark for LLM abstention
  ☆60Updated 3 months ago
• NJUNLP / PATS
  ☆44Updated 6 months ago
• yuleiqin / RAIF
  A Recipe for Building LLM Reasoners to Solve Complex Instructions
  ☆28Updated last month
• yale-nlp / refdpo
  ☆16Updated last year
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆36Updated last year
• YJiangcm / BMC
  [ICLR 2025] Bridging and Modeling Correlations in Pairwise Data for Direct Preference Optimization
  ☆12Updated 10 months ago
• mathllm / Step-Controlled_DPO
  ☆23Updated last year
• sotopia-lab / sotopia-rl
  Sotopia-RL: Reward Design for Social Intelligence
  ☆44Updated 3 months ago
• jinzhuoran / RAG-RewardBench
  RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
  ☆16Updated 11 months ago
• zjunlp / unlearn
  [ACL 2025] Knowledge Unlearning for Large Language Models
  ☆46Updated 2 months ago
• HypherX / Evolution-Analysis
  ☆23Updated 11 months ago
• MLLM-Data-Contamination / MM-Detect
  This repo contains code for the paper "Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM"
  ☆16Updated last month
• uservan / ThinkPO
  ☆17Updated 3 months ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 7 months ago
• yayayacc / MUR
  ☆46Updated last month
• RenzeLou / AAAR-1.0
  The source code for running LLMs on the AAAR-1.0 benchmark.
  ☆17Updated 7 months ago
• wzq016 / PINE
  Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""
  ☆19Updated 5 months ago
• googleinterns / localizing-paragraph-memorization
  ☆15Updated last year
• qiuzh20 / EMoE
  Official PyTorch Implementation of EMoE: Unlocking Emergent Modularity in Large Language Models [main conference @ NAACL2024]
  ☆37Updated last year
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆50Updated 8 months ago
• RUCKBReasoning / CodeRM
  Official code implementation for the ACL 2025 paper: 'Dynamic Scaling of Unit Tests for Code Reward Modeling'
  ☆26Updated 6 months ago
• chtmp223 / suri
  Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)
  ☆26Updated last month
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆40Updated last month
• general-preference / general-preference-model
  [ICML 2025] Beyond Bradley-Terry Models: A General Preference Model for Language Model Alignment (https://arxiv.org/abs/2410.02197)
  ☆31Updated 2 months ago
• fangyuan-ksgk / CoT-Reasoning-without-Prompting
  Unofficial Implementation of Chain-of-Thought Reasoning Without Prompting
  ☆33Updated last year
• mandyyyyii / east
  ☆20Updated 3 months ago
• LAMDASZ-ML / Self-Backtracking
  ☆51Updated 9 months ago
• cvenhoff / steering-thinking-llms
  ☆30Updated 4 months ago