TUDB-Labs / MoE-PEFTLinks
An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT
☆128Updated 9 months ago
Alternatives and similar repositories for MoE-PEFT
Users that are interested in MoE-PEFT are comparing it to the libraries listed below
Sorting:
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆196Updated last year
- ☆167Updated last year
- [EMNLP 2025] TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆194Updated last week
- ☆185Updated 6 months ago
- ☆171Updated last week
- ☆138Updated 3 months ago
- ☆134Updated 9 months ago
- A Sober Look at Language Model Reasoning☆89Updated 3 weeks ago
- This repository contains a regularly updated paper list for LLMs-reasoning-in-latent-space.☆229Updated this week
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆88Updated 9 months ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆143Updated 5 months ago
- Model merging is a highly efficient approach for long-to-short reasoning.☆92Updated last month
- [SIGIR'24] The official implementation code of MOELoRA.☆185Updated last year
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆138Updated last year
- ☆213Updated 9 months ago
- 📖 This is a repository for organizing papers, codes, and other resources related to Latent Reasoning.☆302Updated last month
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆257Updated 6 months ago
- ☆70Updated 7 months ago
- Official repository for paper: O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning☆98Updated 9 months ago
- ☆215Updated 2 weeks ago
- The repo for In-context Autoencoder☆152Updated last year
- [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models☆149Updated 5 months ago
- [ACL'25 Oral] What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective☆74Updated 5 months ago
- [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style☆71Updated 4 months ago
- [EMNLP 2025] LightThinker: Thinking Step-by-Step Compression☆123Updated 8 months ago
- One-shot Entropy Minimization☆187Updated 6 months ago
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆234Updated last year
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆36Updated last year
- Codes for Merging Large Language Models☆34Updated last year
- ☆151Updated last year