Alternatives and similar repositories for BAdam

Users that are interested in BAdam are comparing it to the libraries listed below

• RLHFlow / Online-RLHF
  A recipe for online RLHF and online iterative DPO.
  ☆520Updated 5 months ago
• RLHFlow / Online-DPO-R1
  Codebase for Iterative DPO Using Rule-based Rewards
  ☆247Updated 2 months ago
• RLHFlow / Minimal-RL
  ☆208Updated last month
• Qihoo360 / 360-LLaMA-Factory
  adds Sequence Parallelism into LLaMA-Factory
  ☆518Updated last week
• zhuhanqing / APOLLO
  APOLLO: SGD-like Memory, AdamW-level Performance
  ☆238Updated last month
• uclaml / SPPO
  The official implementation of Self-Play Preference Optimization (SPPO)
  ☆566Updated 5 months ago
• jordddan / Pruning-LLMs
  The framework to prune LLMs to any size and any config.
  ☆93Updated last year
• Simple-Efficient / RL-Factory
  Train your Agent model via our easy and efficient framework
  ☆1,175Updated this week
• AIoT-MLSys-Lab / SVD-LLM
  [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2
  ☆219Updated 3 months ago
• RLHFlow / RLHF-Reward-Modeling
  Recipes to train reward model for RLHF.
  ☆1,380Updated 2 months ago
• dhcode-cpp / X-R1
  minimal-cost for training 0.5B R1-Zero
  ☆743Updated last month
• Outsider565 / LoRA-GA
  ☆201Updated 8 months ago
• step-law / steplaw
  ☆191Updated 2 months ago
• GAIR-NLP / LIMR
  ☆203Updated 4 months ago
• GraphPKU / PiSSA
  PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)
  ☆356Updated last week
• wei-potato / Train-llm-from-scratch
  使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力
  ☆154Updated 11 months ago
• Infini-AI-Lab / TriForce
  [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
  ☆256Updated 9 months ago
• HKUNLP / ChunkLlama
  [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"
  ☆411Updated 8 months ago
• meta-math / MetaMath
  MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models
  ☆436Updated last year
• dvlab-research / Step-DPO
  Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"
  ☆369Updated 5 months ago
• OpenBMB / Eurus
  ☆317Updated 9 months ago
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆373Updated last year
• RUC-GSAI / YuLan-Mini
  A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.
  ☆189Updated 3 weeks ago
• wangyu-ustc / MemoryLLM
  The official implementation of the ICML 2024 paper "MemoryLLM: Towards Self-Updatable Large Language Models" and "M+: Extending MemoryLLM…
  ☆163Updated 4 months ago
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆154Updated last year
• IAAR-Shanghai / UHGEval
  [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.
  ☆167Updated 2 weeks ago
• Strivin0311 / long-llms-learning
  A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks
  ☆263Updated 10 months ago
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆222Updated last month
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆213Updated 4 months ago
• IAAR-Shanghai / ICSFSurvey
  Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…
  ☆169Updated 6 months ago