Alternatives and similar repositories for filtered-dpo:

Users that are interested in filtered-dpo are comparing it to the libraries listed below

• psunlpgroup / VisOnlyQA
  This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…
  ☆22Updated 3 months ago
• uscnlp-lime / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆16Updated 10 months ago
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated last year
• duykhuongnguyen / LASeR-MAB
  Code for paper: "LASeR: Learning to Adaptively Select Reward Models with Multi-Arm Bandits"
  ☆13Updated 5 months ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• allenai / sso
  Repository for Skill Set Optimization
  ☆12Updated 8 months ago
• LooperXX / ManagerTower
  Code for ACL 2023 Oral Paper: ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning
  ☆11Updated 3 months ago
• HKUNLP / DiffuSearch
  [ICLR 2025] Code for the paper "Implicit Search via Discrete Diffusion: A Study on Chess"
  ☆21Updated 3 weeks ago
• formll / resolving-scaling-law-discrepancies
  ☆18Updated 8 months ago
• AllanYangZhou / generative-invariance-transfer
  ☆26Updated 3 years ago
• ys-zong / FoolyourVLLMs
  [ICML 2024] Fool Your (Vision and) Language Model With Embarrassingly Simple Permutations
  ☆14Updated last year
• abaheti95 / LoL-RL
  Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
  ☆26Updated 6 months ago
• ctlllll / reward_collapse
  ☆27Updated last year
• yale-nlp / refdpo
  ☆15Updated 8 months ago
• jason9693 / FROZEN
  ☆14Updated 2 years ago
• minnesotanlp / select-llm
  Parkar and Kim et al.'s paper on Can LLMs Select Important Instructions to Annotate?"
  ☆12Updated 8 months ago
• jiahai-feng / binding-iclr
  ☆12Updated last year
• thu-ml / LM-Calibration
  ☆15Updated last year
• yikangshen / megablocks
  ☆18Updated 9 months ago
• naver-ai / mid.metric
  ☆29Updated 2 years ago
• rtaori / data_feedback
  Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"
  ☆15Updated 2 years ago
• M3-IT / YING-VLM
  Vision Large Language Models trained on M3IT instruction tuning dataset
  ☆17Updated last year
• passing2961 / DialogCC
  Official code and dataset for our NAACL 2024 paper: DialogCC: An Automated Pipeline for Creating High-Quality Multi-modal Dialogue Datase…
  ☆12Updated 9 months ago
• thunlp / DPT
  ☆13Updated 2 years ago
• UCSC-VLAA / Sight-Beyond-Text
  [TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
  ☆19Updated last year
• Hritikbansal / jpo
  ☆12Updated 3 months ago
• violet-zct / swarm-distillation-zero-shot
  ☆22Updated 2 years ago
• cassidylaidlaw / orpo
  ☆14Updated 4 months ago
• PrasannS / rlhf-length-biases
  ☆27Updated last year