Alternatives and similar repositories for PrefPalette

Users that are interested in PrefPalette are comparing it to the libraries listed below

• facebookresearch / AbstentionBench
  A holistic benchmark for LLM abstention
  ☆51Updated 3 weeks ago
• yale-nlp / refdpo
  ☆16Updated last year
• yuleiqin / RAIF
  A Recipe for Building LLM Reasoners to Solve Complex Instructions
  ☆22Updated last month
• MLLM-Data-Contamination / MM-Detect
  This repo contains code for the paper "Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM"
  ☆16Updated last month
• DualityRL / multi-attempt
  ☆19Updated 6 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆34Updated 3 weeks ago
• googleinterns / localizing-paragraph-memorization
  ☆14Updated last year
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆35Updated 11 months ago
• YJiangcm / BMC
  [ICLR 2025] Bridging and Modeling Correlations in Pairwise Data for Direct Preference Optimization
  ☆12Updated 7 months ago
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆47Updated 6 months ago
• uservan / ThinkPO
  ☆18Updated last month
• mandyyyyii / east
  ☆20Updated last month
• yayayacc / MUR
  ☆45Updated last week
• zjunlp / unlearn
  [ACL 2025] Knowledge Unlearning for Large Language Models
  ☆41Updated 4 months ago
• limenlp / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• NJUNLP / PATS
  ☆45Updated 3 months ago
• RenzeLou / AAAR-1.0
  The source code for running LLMs on the AAAR-1.0 benchmark.
  ☆17Updated 5 months ago
• jinzhuoran / RAG-RewardBench
  RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
  ☆16Updated 9 months ago
• open-compass / GPassK
  [ACL 2025] Are Your LLMs Capable of Stable Reasoning?
  ☆30Updated last month
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 5 months ago
• cvenhoff / steering-thinking-llms
  ☆27Updated 2 months ago
• bryanchrist / MathNeuro
  Codebase for Math Neurosurgery: Isolating LLMs' Math Reasoning Abilities Using Only Forward Passes
  ☆19Updated 3 months ago
• matchten / LoRA-Models-for-SAEs
  Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"
  ☆14Updated 5 months ago
• HypherX / Evolution-Analysis
  ☆23Updated 9 months ago
• RUCKBReasoning / CodeRM
  Official code implementation for the ACL 2025 paper: 'Dynamic Scaling of Unit Tests for Code Reward Modeling'
  ☆25Updated 4 months ago
• icip-cas / SSO
  A scalable automated alignment method for large language models. Resources for "Aligning Large Language Models via Self-Steering Optimiza…
  ☆20Updated 10 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆92Updated 10 months ago
• sotopia-lab / sotopia-rl
  Sotopia-RL: Reward Design for Social Intelligence
  ☆39Updated last month
• tianyi-lab / C3PO
  Code for "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"
  ☆18Updated 5 months ago
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆29Updated 7 months ago