inclusionAI / MoBELinks
Mixture-of-Basis-Experts for Compressing MoE-based LLMs
☆26Updated last month
Alternatives and similar repositories for MoBE
Users that are interested in MoBE are comparing it to the libraries listed below
Sorting:
- A comprehensive and efficient long-context model evaluation framework☆30Updated this week
- Control LLM☆22Updated 10 months ago
- [ICML 2025] LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models☆17Updated 3 months ago
- [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"☆19Updated 10 months ago
- ☆16Updated last year
- [ICML'25] Official code of paper "Fast Large Language Model Collaborative Decoding via Speculation"☆28Updated 7 months ago
- [COLM 2025] "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"☆19Updated 10 months ago
- ☆14Updated last year
- [NeurIPS 2025] Official implementation of "Reasoning Path Compression: Compressing Generation Trajectories for Efficient LLM Reasoning"☆30Updated 3 months ago
- [ACL 2025] Are Your LLMs Capable of Stable Reasoning?☆32Updated 6 months ago
- ☆19Updated last year
- Official Implementation of APB (ACL 2025 main Oral) and Spava.☆32Updated last week
- ☆13Updated last year
- SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper☆32Updated last year
- An End-to-End Model with Adaptive Filtering for Retrieval-Augmented Generation☆16Updated last year
- The first spoken long-text dataset derived from live streams, designed to reflect the redundancy-rich and conversational nature of real-w…☆13Updated 7 months ago
- This repo contains code for the paper "Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM"☆17Updated 3 months ago
- DCPO: Dynamic Adaptive Clipping for RL☆45Updated last month
- Learning to Skip the Middle Layers of Transformers☆17Updated 6 months ago
- Code for paper: Long cOntext aliGnment via efficient preference Optimization☆24Updated 4 months ago
- Are gradient information useful for pruning of LLMs?☆47Updated 5 months ago
- ☆15Updated last year
- ROUTE: Robust Multitask Tuning and Collaboration for Text-to-SQL (ICLR 2025 Pytorch Code)☆17Updated 8 months ago
- ☆49Updated 5 months ago
- Official implementation of the paper: "A deeper look at depth pruning of LLMs"☆15Updated last year
- [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models☆60Updated last year
- MUA-RL: MULTI-TURN USER-INTERACTING AGENT REINFORCEMENT LEARNING FOR AGENTIC TOOL USE☆56Updated 3 months ago
- ☆17Updated 6 months ago
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆29Updated 6 months ago
- ☆18Updated 11 months ago