Ledzy / BAdamLinks
[NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models
☆270Updated 6 months ago
Alternatives and similar repositories for BAdam
Users that are interested in BAdam are comparing it to the libraries listed below
Sorting:
- A recipe for online RLHF and online iterative DPO.☆529Updated 9 months ago
- ☆234Updated 4 months ago
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models☆445Updated last year
- A scalable, end-to-end training pipeline for general-purpose agents☆359Updated 3 months ago
- The official implementation of Self-Play Preference Optimization (SPPO)☆583Updated 8 months ago
- APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention☆256Updated 5 months ago
- adds Sequence Parallelism into LLaMA-Factory☆564Updated last week
- Codebase for Iterative DPO Using Rule-based Rewards☆257Updated 5 months ago
- The framework to prune LLMs to any size and any config.☆94Updated last year
- [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2☆253Updated last month
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆356Updated last week
- ☆318Updated last month
- ☆116Updated last year
- Controllable Text Generation for Large Language Models: A Survey☆188Updated last year
- ☆210Updated 11 months ago
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆266Updated last year
- ☆202Updated 5 months ago
- The official implementation of the ICML 2024 paper "MemoryLLM: Towards Self-Updatable Large Language Models" and "M+: Extending MemoryLLM…☆226Updated 2 months ago
- Recipes to train the self-rewarding reasoning LLMs.☆226Updated 7 months ago
- [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.☆175Updated 3 months ago
- ☆158Updated last year
- A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks☆268Updated last year
- improve Llama-2's proficiency in comprehension, generation, and translation of Chinese.☆445Updated last year
- Recipes to train reward model for RLHF.☆1,455Updated 5 months ago
- [ICML 2025] "SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator"☆551Updated 2 months ago
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆169Updated 9 months ago
- Official implementation of TransNormerLLM: A Faster and Better LLM☆247Updated last year
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆163Updated last year
- Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning☆190Updated 6 months ago
- TransMLA: Multi-Head Latent Attention Is All You Need (NeurIPS 2025 Spotlight)☆372Updated last week