The open-source Mixture of Depths code and the official implementation of the paper "Router-Tuning: A Simple and Effective Approach for Enabling Dynamic Depth in Transformers. (EMNLP 2025)"
☆31Jul 20, 2026Updated 3 weeks ago
Alternatives and similar repositories for Router-Tuning-Mixture-of-Depths
Users that are interested in Router-Tuning-Mixture-of-Depths are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official implementation of the paper "Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of Experts" (ICLR 2026).☆20May 31, 2026Updated 2 months ago
- The official implementation of the paper "Rethinking Pruning for Vision-Language Models: Strategies for Effective Sparsity".☆17Jul 2, 2024Updated 2 years ago
- Pytorch Code for FedHyper☆11Aug 28, 2024Updated last year
- [NeurIPS 2025] Neural Discrete Token Representation Learning for Extreme Token Reduction in Video Large Language Models☆17Updated this week
- The official implementation of the paper "Uncovering the Redundancy in Transformers via a Unified Study of Layer Dropping (TMLR)".☆191Apr 23, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Implementation for EACL 2024 paper "Corpus-Steered Query Expansion with Large Language Models"☆13Mar 19, 2024Updated 2 years ago
- Code release for AdapMoE accepted by ICCAD 2024☆39Apr 28, 2025Updated last year
- ☆14Aug 18, 2022Updated 3 years ago
- ThinkJEPA: Empowering Latent World Models with Large Vision-Language Reasoning Model☆51Jul 19, 2026Updated 3 weeks ago
- Sparse Backpropagation for Mixture-of-Expert Training☆30Jul 2, 2024Updated 2 years ago
- A LaTeX framework to handle Personal Statement (PS) and Statement of Purpose (SoP) for multiple university applications.☆28Jul 24, 2026Updated 3 weeks ago
- ☆22Oct 3, 2024Updated last year
- Tensorflow code for "Hierarchical Decompositional Mixtures of Variational Autoencoders" (ICML'19)☆12Jun 7, 2020Updated 6 years ago
- Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…☆31Nov 14, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 🚀enhanced GRPO with more verifiable rewards and real-time evaluators☆37Jan 27, 2026Updated 6 months ago
- The information of NLP PhD application in the world.☆37Aug 27, 2024Updated last year
- [ICML 2024] Code for the paper "MoE-RBench: Towards Building Reliable Language Models with Sparse Mixture-of-Experts"☆11Jul 1, 2024Updated 2 years ago
- Official Repo for DAC-RL: Training LLMs for Divide-and-Conquer Reasoning Elevates Test-Time Scalability☆16Feb 26, 2026Updated 5 months ago
- Implementation for ACL 2024 paper "Meta-Task Prompting Elicits Embeddings from Large Language Models"☆12Jul 25, 2024Updated 2 years ago
- 🧠Plan-and-Budget: Training-free test-time reasoning framework for adaptive token allocation in large language models (ICLR 2026).☆15Mar 2, 2026Updated 5 months ago
- The open-source repository for PAL: Sample-Efficient Personalized Reward Modeling for Pluralistic Alignment, which provides a general per…☆17Aug 28, 2025Updated 11 months ago
- [ACL 2025] Analyzing LLMs' Multilingual Knowledge Boundary Cognition Across Languages Through the Lens of Internal Representations☆19Oct 18, 2025Updated 9 months ago
- awesome video representation learning☆15Mar 22, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆18Dec 11, 2024Updated last year
- ☆21Jun 4, 2024Updated 2 years ago
- ☆26Oct 20, 2022Updated 3 years ago
- The Compositionality article class.☆14Mar 16, 2026Updated 4 months ago
- ☆13Jul 14, 2024Updated 2 years ago
- Website for HKU NLP group (under construction)☆15Jul 6, 2026Updated last month
- ☆12Sep 23, 2024Updated last year
- [Tool] AutoRec (2015) PyTorch Implementation☆10Mar 1, 2020Updated 6 years ago
- [ICCV 2025] Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"☆65Oct 9, 2025Updated 10 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- DeciMamba: Exploring the Length Extrapolation Potential of Mamba (ICLR 2025)☆32Apr 9, 2025Updated last year
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated 2 years ago
- ☆66Jan 11, 2025Updated last year
- Codebase, data and models for hallucination of pruned models☆16Jan 11, 2025Updated last year
- 模型加速/模型压缩（已完成所有Lab）☆11Dec 24, 2023Updated 2 years ago
- ☆10Oct 8, 2021Updated 4 years ago
- ☆14Apr 15, 2025Updated last year