Ledzy / BAdamLinks
[NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models
☆284Updated 10 months ago
Alternatives and similar repositories for BAdam
Users that are interested in BAdam are comparing it to the libraries listed below
Sorting:
- A recipe for online RLHF and online iterative DPO.☆538Updated last year
- ☆260Updated 8 months ago
- The official implementation of Self-Play Preference Optimization (SPPO)☆583Updated last year
- adds Sequence Parallelism into LLaMA-Factory☆602Updated 3 months ago
- ☆217Updated 2 months ago
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models☆453Updated last year
- A scalable, end-to-end training pipeline for general-purpose agents☆362Updated 6 months ago
- Codebase for Iterative DPO Using Rule-based Rewards☆267Updated 9 months ago
- APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention☆267Updated 2 months ago
- The official implementation of the ICML 2024 paper "MemoryLLM: Towards Self-Updatable Large Language Models" and "M+: Extending MemoryLLM…☆287Updated 6 months ago
- ☆332Updated 5 months ago
- ☆209Updated 3 months ago
- Controllable Text Generation for Large Language Models: A Survey☆199Updated last year
- PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)☆407Updated 7 months ago
- ☆125Updated last year
- [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.☆180Updated 7 months ago
- Recipes to train reward model for RLHF.☆1,508Updated 9 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆168Updated last year
- [Preprint] On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.☆526Updated 3 weeks ago
- minimal-cost for training 0.5B R1-Zero☆805Updated 8 months ago
- [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2☆275Updated 5 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆394Updated last year
- Official implementation of TransNormerLLM: A Faster and Better LLM☆249Updated 2 years ago
- a-m-team's exploration in large language modeling☆195Updated 8 months ago
- The framework to prune LLMs to any size and any config.☆94Updated last year
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆496Updated last week
- [ICML 2025] "SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator"☆560Updated 6 months ago
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆260Updated last year
- ☆175Updated last year
- ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]☆199Updated 6 months ago