Alternatives and similar repositories for dpo-notes

Users that are interested in dpo-notes are comparing it to the libraries listed below

• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆92Updated 4 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆72Updated last year
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆102Updated 9 months ago
• SALT-NLP / demonstrated-feedback
  ☆124Updated 9 months ago
• neubig / minllama-assignment
  ☆88Updated 9 months ago
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆56Updated 2 months ago
• tianyi-lab / MoE-Embedding
  Code for "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"
  ☆74Updated 9 months ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆259Updated 3 weeks ago
• multimodal-art-projection / LatentCoT-Horizon
  📖 This is a repository for organizing papers, codes, and other resources related to Latent Reasoning.
  ☆86Updated this week
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated 10 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆174Updated 3 months ago
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆47Updated 5 months ago
• THUDM / ComplexFuncBench
  Complex Function Calling Benchmark.
  ☆117Updated 5 months ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆111Updated 5 months ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆59Updated last year
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆55Updated 2 weeks ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆160Updated 4 months ago
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆108Updated 2 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated 10 months ago
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆266Updated last month
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated 8 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆144Updated 7 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated 9 months ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆45Updated 7 months ago
• microsoft / lost_in_conversation
  Code that accompanies the public release of the paper Lost in Conversation (https://arxiv.org/abs/2505.06120)
  ☆141Updated 3 weeks ago
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆64Updated 11 months ago
• nyunAI / Faster-LLM-Survey
  ☆42Updated last year
• ScalingIntelligence / large_language_monkeys
  ☆96Updated 9 months ago
• DataArcTech / LLM-as-a-Judge
  ☆122Updated 3 months ago
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆158Updated 3 months ago