Ledzy / BAdamLinks
[NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models
☆265Updated 4 months ago
Alternatives and similar repositories for BAdam
Users that are interested in BAdam are comparing it to the libraries listed below
Sorting:
- A recipe for online RLHF and online iterative DPO.☆524Updated 7 months ago
- ☆218Updated 2 months ago
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models☆438Updated last year
- A scalable, end-to-end training pipeline for general-purpose agents☆349Updated last month
- Codebase for Iterative DPO Using Rule-based Rewards☆255Updated 3 months ago
- Controllable Text Generation for Large Language Models: A Survey☆184Updated 11 months ago
- adds Sequence Parallelism into LLaMA-Factory☆538Updated this week
- The official implementation of Self-Play Preference Optimization (SPPO)☆574Updated 6 months ago
- APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention☆250Updated 3 months ago
- Recipes to train the self-rewarding reasoning LLMs.☆224Updated 5 months ago
- minimal-cost for training 0.5B R1-Zero☆765Updated 2 months ago
- ☆107Updated last year
- The framework to prune LLMs to any size and any config.☆94Updated last year
- Train your Agent model via our easy and efficient framework☆1,317Updated this week
- Recipes to train reward model for RLHF.☆1,418Updated 3 months ago
- The official implementation of the ICML 2024 paper "MemoryLLM: Towards Self-Updatable Large Language Models" and "M+: Extending MemoryLLM…☆203Updated last week
- [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2☆233Updated 4 months ago
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆204Updated this week
- ☆204Updated 9 months ago
- An automated pipeline for evaluating LLMs for role-playing.☆192Updated 10 months ago
- PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)☆367Updated last month
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆405Updated 7 months ago
- a-m-team's exploration in large language modeling☆178Updated 2 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆157Updated last year
- ☆198Updated 3 months ago
- [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.☆170Updated last month
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆238Updated 5 months ago
- ☆148Updated last year
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆200Updated last week
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆170Updated 7 months ago