[TMLR] Offical Implementation of ToMoE: ToMoE: Converting Dense Large Language Models to Mixture-of-Experts through Dynamic Structural Pruning
☆42Aug 27, 2026Updated 2 months ago
Alternatives and similar repositories for ToMoE
Users that are interested in ToMoE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2025] Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization☆26Oct 5, 2025Updated last year
- An implementation of the DISP-LLM method from the NeurIPS 2024 paper: Dimension-Independent Structural Pruning for Large Language Models.☆25Aug 6, 2025Updated last year
- [TMLR 2026] LibMoE: A LIBRARY FOR COMPREHENSIVE BENCHMARKING MIXTURE OF EXPERTS IN LARGE LANGUAGE MODELS☆52May 26, 2026Updated 5 months ago
- HydraNet is a state-of-the-art transformer architecture that combines Multi-Query Attention (MQA), Mixture of Experts (MoE), and continuo…☆14Nov 2, 2026Updated last week
- Solving Token Gradient Conflict in Mixture-of-Experts for Large Vision-Language Model☆13Feb 11, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆11Jun 16, 2026Updated 4 months ago
- Scaling Laws for Mixture of Experts Models☆16Feb 25, 2025Updated last year
- A paper list shared in the group meeting☆13Nov 13, 2025Updated 11 months ago
- Mixture-of-Experts Multimodal Variational Autoencoder☆15Jul 3, 2025Updated last year
- ☆10Dec 13, 2024Updated last year
- ☆12Aug 19, 2025Updated last year
- [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"☆19Mar 10, 2025Updated last year
- The code of 《M4: Multi-Proxy Multi-Gate Mixture of Experts Network for Multiple Instance Learning in Histopathology Image Analysis》☆14Mar 31, 2025Updated last year
- MoE-Visualizer is a tool designed to visualize the selection of experts in Mixture-of-Experts (MoE) models.☆17Apr 8, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [CVPR 2025] CL-MoE: Enhancing Multimodal Large Language Model with Dual Momentum Mixture-of-Experts for Continual Visual Question Answeri…☆63Jun 16, 2025Updated last year
- Alpaca against Vicuna: Using LLMs to Uncover Memorization of LLMs☆10Aug 17, 2024Updated 2 years ago
- Pytorch implementation of our paper accepted by ICML 2023 -- "Bi-directional Masks for Efficient N:M Sparse Training"☆14Jun 7, 2023Updated 3 years ago
- Paquetes con el API y modelos de la DGII en .NET Core☆11Oct 15, 2026Updated 3 weeks ago
- The code for "MoPE: Mixture of Prefix Experts for Zero-Shot Dialogue State Tracking"☆19Jan 25, 2025Updated last year
- Official repository for Reflecting Reality: Enabling Diffusion Models to Produce Faithful Mirror Reflections☆20Jun 7, 2025Updated last year
- DiTASK: Multi-Task Fine-Tuning with Diffeomorphic Transformations (CVPR 2025)☆14Jun 1, 2025Updated last year
- Code for "Routing Manifold Alignment Improves Generalization of Mixture-of-Experts LLMs"☆19Nov 6, 2025Updated last year
- Official Repository for "WUSH: Near-Optimal Adaptive Transforms for LLM Quantization" (ICML 2026)☆18Jun 30, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official Code of The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks[ICML2022]☆16Sep 20, 2022Updated 4 years ago
- Port of Abuse for PSVITA/PSTV.☆14Apr 13, 2021Updated 5 years ago
- [ACL 2021] IrEne: Interpretable Energy Prediction for Transformers☆12Sep 8, 2021Updated 5 years ago
- Code for the paper: On Symmetric Losses for Learning from Corrupted Labels☆19May 11, 2019Updated 7 years ago
- ☆17Feb 23, 2025Updated last year
- Code for Learned Thresholds Token Merging and Pruning for Vision Transformers (LTMP). A technique to reduce the size of Vision Transforme…☆17Nov 24, 2024Updated last year
- IAM Dataset Writer Recognition Using a CNN☆13Nov 12, 2018Updated 7 years ago
- Dataset of Clarification Questions☆22Jun 15, 2020Updated 6 years ago
- Repo for OpenCarbonEval: A Unified Carbon Emission Estimation Framework in Large-Scale AI Models☆11May 21, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Session at a glance — always-visible recap panel for pi coding agent☆12May 12, 2026Updated 5 months ago
- [CVPR 2025] Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Experts☆26Jun 22, 2025Updated last year
- Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…☆130Oct 26, 2026Updated 2 weeks ago
- pk pkh pfs archive extractor for The Last Story.☆13Nov 17, 2019Updated 6 years ago
- This repository contains code for the MicroAdam paper.☆21Dec 14, 2024Updated last year
- Fast, daily-updated skill and CLI for arXiv, PubMed, PMC, and policy retrieval☆16Jul 8, 2026Updated 4 months ago
- Community Implementation of the paper: "Multi-Head Mixture-of-Experts" In PyTorch☆31Oct 26, 2026Updated 2 weeks ago
Are these results useful?