Alternatives and similar repositories for filtered-dpo:

Users that are interested in filtered-dpo are comparing it to the libraries listed below

• limenlp / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• yale-nlp / refdpo
  ☆16Updated 9 months ago
• psunlpgroup / VisOnlyQA
  This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…
  ☆22Updated 3 weeks ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆17Updated 11 months ago
• petezh / OpenD5
  Tasks for describing differences between text distributions.
  ☆16Updated 8 months ago
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆32Updated 11 months ago
• liziniu / GEM
  Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
  ☆17Updated 3 weeks ago
• PrasannS / rlhf-length-biases
  ☆28Updated last year
• allenai / sso
  Repository for Skill Set Optimization
  ☆12Updated 9 months ago
• Vinoground / Vinoground
  ☆10Updated 5 months ago
• formll / resolving-scaling-law-discrepancies
  ☆18Updated 9 months ago
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆39Updated last month
• abaheti95 / LoL-RL
  Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
  ☆26Updated 7 months ago
• ctlllll / reward_collapse
  ☆27Updated last year
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆26Updated last year
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆25Updated 5 months ago
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• DynaMath / DynaMath
  A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models
  ☆19Updated 5 months ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆43Updated last week
• xhan77 / in-context-alignment
  In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning
  ☆34Updated last year
• RLHFlow / RAFT
  This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…
  ☆29Updated 7 months ago
• UCSB-NLP-Chang / Prereq_tune
  Implementation for the paper "Fictitious Synthetic Data Can Improve LLM Factuality via Prerequisite Learning"
  ☆9Updated 3 months ago
• yifeiwang77 / Self-Correction
  ☆20Updated 5 months ago
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆57Updated 7 months ago
• lqtrung1998 / mwp_cot_design
  ☆13Updated last year
• googleinterns / localizing-paragraph-memorization
  ☆14Updated last year
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated last year
• duykhuongnguyen / LASeR-MAB
  Code for paper: "LASeR: Learning to Adaptively Select Reward Models with Multi-Arm Bandits"
  ☆13Updated 6 months ago
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆26Updated 4 months ago
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆19Updated last year