Ledzy / BAdam
[NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models
☆243Updated 2 months ago
Alternatives and similar repositories for BAdam:
Users that are interested in BAdam are comparing it to the libraries listed below
- A recipe for online RLHF and online iterative DPO.☆484Updated last month
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆266Updated 2 months ago
- The official implementation of Self-Play Preference Optimization (SPPO)☆481Updated 3 weeks ago
- ☆177Updated 4 months ago
- PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)☆324Updated 2 weeks ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆284Updated 9 months ago
- Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conv…☆408Updated 2 months ago
- Controllable Text Generation for Large Language Models: A Survey☆157Updated 5 months ago
- [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.☆158Updated 3 months ago
- This is the repo for the paper "OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use".☆201Updated this week
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models☆407Updated last year
- Recipes to train reward model for RLHF.☆1,181Updated last week
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆291Updated last year
- The nanoGPT-style implementation of RWKV Language Model - an RNN with GPT-level LLM performance.☆184Updated last year
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆153Updated 8 months ago
- [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.☆233Updated 3 months ago
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆239Updated 5 months ago
- The framework to prune LLMs to any size and any config.☆87Updated 11 months ago
- Unified KV Cache Compression Methods for Auto-Regressive Models☆886Updated last month
- Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"☆348Updated last month
- ☆104Updated 3 months ago
- ☆123Updated 6 months ago
- Rectified Rotary Position Embeddings☆351Updated 9 months ago
- Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition☆276Updated last month
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆155Updated 2 months ago
- improve Llama-2's proficiency in comprehension, generation, and translation of Chinese.☆449Updated 10 months ago
- RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness☆294Updated 2 months ago
- A series of technical report on Slow Thinking with LLM☆411Updated last week