Ledzy / BAdam
[NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models
☆252Updated last month
Alternatives and similar repositories for BAdam:
Users that are interested in BAdam are comparing it to the libraries listed below
- A recipe for online RLHF and online iterative DPO.☆506Updated 3 months ago
- Codebase for Iterative DPO Using Rule-based Rewards☆237Updated last week
- adds Sequence Parallelism into LLaMA-Factory☆461Updated this week
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models☆428Updated last year
- Recipes to train reward model for RLHF.☆1,290Updated 2 months ago
- Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conv…☆437Updated last month
- minimal-cost for training 0.5B R1-Zero☆699Updated 3 weeks ago
- The official implementation of Self-Play Preference Optimization (SPPO)☆524Updated 2 months ago
- [ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2☆197Updated last month
- The framework to prune LLMs to any size and any config.☆91Updated last year
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆339Updated 4 months ago
- PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)☆345Updated 2 months ago
- Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"☆283Updated 3 months ago
- ☆178Updated this week
- APOLLO: SGD-like Memory, AdamW-level Performance☆202Updated this week
- improve Llama-2's proficiency in comprehension, generation, and translation of Chinese.☆450Updated last year
- ☆191Updated 5 months ago
- DeepRetrieval - Hacking 🔥Real Search Engines and Retrievers with LLM via RL☆372Updated this week
- [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.☆162Updated 5 months ago
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆164Updated 4 months ago
- Unified KV Cache Compression Methods for Auto-Regressive Models☆1,009Updated 3 months ago
- The official implementation of the ICML 2024 paper "MemoryLLM: Towards Self-Updatable Large Language Models" and "M+: Extending MemoryLLM…☆141Updated 2 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆153Updated 10 months ago
- Recipes to train the self-rewarding reasoning LLMs.☆212Updated last month
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆319Updated last year
- Controllable Text Generation for Large Language Models: A Survey☆167Updated 7 months ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆256Updated 7 months ago
- ☆380Updated 4 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆318Updated 11 months ago
- ✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork☆200Updated 2 weeks ago