Ledzy / BAdamLinks
[NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models
☆286Updated 10 months ago
Alternatives and similar repositories for BAdam
Users that are interested in BAdam are comparing it to the libraries listed below
Sorting:
- A recipe for online RLHF and online iterative DPO.☆539Updated last year
- ☆262Updated 8 months ago
- A scalable, end-to-end training pipeline for general-purpose agents☆366Updated 7 months ago
- APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention☆270Updated 2 months ago
- adds Sequence Parallelism into LLaMA-Factory☆604Updated this week
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models☆454Updated 2 years ago
- Codebase for Iterative DPO Using Rule-based Rewards☆267Updated 9 months ago
- The official implementation of Self-Play Preference Optimization (SPPO)☆582Updated last year
- [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2☆280Updated 5 months ago
- ☆334Updated 5 months ago
- The framework to prune LLMs to any size and any config.☆94Updated last year
- Controllable Text Generation for Large Language Models: A Survey☆200Updated last year
- [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.☆180Updated 8 months ago
- ☆218Updated 2 months ago
- Recipes to train the self-rewarding reasoning LLMs.☆229Updated 11 months ago
- [ICML 2025] "SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator"☆561Updated 6 months ago
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆171Updated last year
- ✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork☆312Updated 5 months ago
- The official implementation of the ICML 2024 paper "MemoryLLM: Towards Self-Updatable Large Language Models" and "M+: Extending MemoryLLM…☆290Updated 6 months ago
- Train your Agent model via our easy and efficient framework☆1,701Updated 2 months ago
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆276Updated last year
- Recipes to train reward model for RLHF.☆1,512Updated 9 months ago
- Deep Research Agent CognitiveKernel-Pro from Tencent AI Lab. Paper: https://arxiv.org/pdf/2508.00414☆491Updated 3 months ago
- ☆209Updated 3 months ago
- minimal-cost for training 0.5B R1-Zero☆806Updated 8 months ago
- A library for generating difficulty-scalable, multi-tool, and verifiable agentic tasks with execution trajectories.☆177Updated 7 months ago
- ☆1,115Updated 3 weeks ago
- improve Llama-2's proficiency in comprehension, generation, and translation of Chinese.☆443Updated last year
- a toolkit on knowledge distillation for large language models☆266Updated this week
- Official code of "StreamBP: Memory-Efficient Exact Backpropagation for Long Sequence Training of LLMs".☆74Updated 7 months ago