Alternatives and similar repositories for TPO

Users that are interested in TPO are comparing it to the libraries listed below

• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆42Updated 8 months ago
• Joshua-Ren / Learning_dynamics_LLM
  ☆139Updated last month
• VITA-Group / SEAL
  Official code for SEAL: Steerable Reasoning Calibration of Large Language Models for Free
  ☆28Updated 2 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆74Updated last week
• ChnQ / TracingLLM
  ☆26Updated last year
• Raibows / CREAM
  Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.
  ☆22Updated 4 months ago
• tmlr-group / landscape-of-thoughts
  [ICLR 2025 Workshop] "Landscape of Thoughts: Visualizing the Reasoning Process of Large Language Models"
  ☆25Updated last week
• rookie-joe / AutoPSV
  ☆46Updated 7 months ago
• SihengLi99 / LLM-Honesty-Survey
  A Survey on the Honesty of Large Language Models
  ☆57Updated 6 months ago
• Zayne-sprague / To-CoT-or-not-to-CoT
  ☆24Updated 2 months ago
• princeton-nlp / unintentional-unalignment
  [ICLR 2025] Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
  ☆29Updated 5 months ago
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆60Updated 7 months ago
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆62Updated 2 months ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆59Updated 9 months ago
• socialfoundations / tttlm
  Test-time-training on nearest neighbors for large language models
  ☆41Updated last year
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆26Updated 6 months ago
• haotiansun14 / BBox-Adapter
  Lightweight Adapting for Black-Box Large Language Models
  ☆22Updated last year
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆61Updated 6 months ago
• hkust-nlp / Activation_Decoding
  In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)
  ☆59Updated last year
• javiferran / sae_entities
  ☆44Updated 3 months ago
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆49Updated last year
• ShadeCloak / ADORA
  ☆46Updated 2 months ago
• tatsu-lab / test_set_contamination
  ☆37Updated last year
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆88Updated 8 months ago
• mathllm / Step-Controlled_DPO
  ☆22Updated 11 months ago
• MingyuJ666 / The-Impact-of-Reasoning-Step-Length-on-Large-Language-Models
  [ACL'24] Chain of Thought (CoT) is significant in improving the reasoning abilities of large language models (LLMs). However, the correla…
  ☆45Updated last month
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆73Updated 4 months ago
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆63Updated 6 months ago
• ADaM-BJTU / W2SG
  The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”
  ☆16Updated last year