Alternatives and similar repositories for llmft

Users that are interested in llmft are comparing it to the libraries listed below

• facebookresearch / RLCD
  Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment
  ☆69Updated 2 years ago
• matchten / LoRA-Models-for-SAEs
  Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"
  ☆14Updated 5 months ago
• gregorbachmann / Next-Token-Failures
  ☆98Updated last year
• roeehendel / icl_task_vectors
  ☆96Updated last year
• google-deepmind / emergent_in_context_learning
  ☆84Updated last year
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆31Updated 7 months ago
• martin-wey / CodeUltraFeedback
  CodeUltraFeedback: aligning large language models to coding preferences (TOSEM 2025)
  ☆72Updated last year
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆47Updated 5 months ago
• architsharma97 / dpo-rlaif
  ☆100Updated last year
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆79Updated 8 months ago
• tomekkorbak / pretraining-with-human-feedback
  Code accompanying the paper Pretraining Language Models with Human Preferences
  ☆180Updated last year
• terarachang / DataICL
  Data Valuation on In-Context Examples (ACL23)
  ☆24Updated 7 months ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆21Updated last year
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆47Updated 8 months ago
• abaheti95 / LoL-RL
  Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
  ☆26Updated 11 months ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆100Updated last year
• princeton-nlp / Edge-Pruning
  [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆59Updated 2 weeks ago
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆30Updated last year
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆116Updated last year
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆203Updated 11 months ago
• tianjunz / TEMPERA
  ☆46Updated 2 years ago
• archiki / GrIPS
  Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"
  ☆56Updated 2 years ago
• ctlllll / reward_collapse
  ☆27Updated 2 years ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 4 months ago
• zlin7 / UQ-NLG
  ☆99Updated last year
• xiamengzhou / training_trajectory_analysis
  [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf
  ☆24Updated last year
• nouhadziri / faith-and-fate
  ☆35Updated last year
• formll / resolving-scaling-law-discrepancies
  ☆20Updated last year
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆59Updated 11 months ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆94Updated 3 years ago