inclusionAI / MoBELinks
Mixture-of-Basis-Experts for Compressing MoE-based LLMs
☆18Updated 3 weeks ago
Alternatives and similar repositories for MoBE
Users that are interested in MoBE are comparing it to the libraries listed below
Sorting:
- A comprehensive and efficient long-context model evaluation framework☆19Updated 2 months ago
- ☆15Updated last year
- This repo contains code for the paper "Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM"☆16Updated 2 months ago
- Resa: Transparent Reasoning Models via SAEs☆41Updated 2 weeks ago
- Official implementation of "Reasoning Path Compression: Compressing Generation Trajectories for Efficient LLM Reasoning"☆22Updated 4 months ago
- Official implementation of ECCV24 paper: POA☆24Updated last year
- DCPO: Dynamic Adaptive Clipping for RL☆34Updated 2 weeks ago
- A Recipe for Building LLM Reasoners to Solve Complex Instructions☆24Updated 2 months ago
- [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"☆16Updated 6 months ago
- Control LLM☆19Updated 6 months ago
- Code for paper: Long cOntext aliGnment via efficient preference Optimization☆13Updated 7 months ago
- Code for "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"☆18Updated 6 months ago
- [ACM MM25] LongWriter-V: Enabling Ultra-Long and High-Fidelity Generation in Vision-Language Models☆19Updated 6 months ago
- An End-to-End Model with Adaptive Filtering for Retrieval-Augmented Generation☆15Updated 11 months ago
- SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper☆33Updated last year
- Official Implementation of our paper "THOR: Tool-Integrated Hierarchical Optimization via RL for Mathematical Reasoning".☆26Updated 2 weeks ago
- [ICLR 2025] Weighted-Reward Preference Optimization for Implicit Model Fusion☆13Updated 6 months ago
- ☆16Updated 7 months ago
- ☆19Updated 9 months ago
- [ICLR 2025] Bridging and Modeling Correlations in Pairwise Data for Direct Preference Optimization☆12Updated 8 months ago
- CS194-196 Course Project☆15Updated 7 months ago
- Bayes-Adaptive RL for LLM Reasoning☆39Updated 4 months ago
- ☆13Updated 8 months ago
- This is a simple torch implementation of the high performance Multi-Query Attention☆15Updated 2 years ago
- ☆19Updated 6 months ago
- The official implementation of Preference Data Reward-Augmentation.☆18Updated 5 months ago
- [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents☆46Updated 7 months ago
- ☆18Updated 2 months ago
- Learning to Skip the Middle Layers of Transformers☆15Updated 2 months ago
- ☆22Updated last year