The code of Advancing Expert Specialization for Better MoE (NeurIPS2025 oral)
☆35Jan 22, 2026Updated 9 months ago
Alternatives and similar repositories for Auxloss-For-Advancing-Expert-Specialization
Users that are interested in Auxloss-For-Advancing-Expert-Specialization are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Compositional Muon release☆25Jun 5, 2026Updated 4 months ago
- ☆18Sep 27, 2026Updated last month
- ☆20Aug 9, 2026Updated 2 months ago
- Quasar Attention Continuous-Time Memory Dynamics for Scaling Models Context to Millions of Tokens☆30Mar 26, 2026Updated 7 months ago
- Research slot☆14Apr 16, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ICLR 2025] Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization☆25Oct 5, 2025Updated last year
- Official repository for the paper "Blending Complementary Memory Systems in Hybrid Quadratic-Linear Transformers"☆13Jun 3, 2025Updated last year
- Use the tokenizer in parallel to achieve superior acceleration☆20Mar 21, 2024Updated 2 years ago
- Expert Specialization MoE Solution based on CUTLASS☆27Apr 14, 2026Updated 6 months ago
- Official Pytorch Implementation of "Outlier-weighed Layerwise Sampling for LLM Fine-tuning" by Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei …☆35Jun 3, 2025Updated last year
- Grouped Query Experts☆12Sep 21, 2026Updated last month
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated last month
- ☆24Dec 6, 2025Updated 10 months ago
- [ICML 2025] Diff-MoE: Diffusion Transformer with Time-Aware and Space-Adaptive Experts☆36Nov 10, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [ICML 2025] Retraining-Free Merging of Sparse MoE via Hierarchical Clustering☆24Oct 26, 2025Updated last year
- ☆38Dec 31, 2025Updated 10 months ago
- https://arxiv.org/abs/2610.13990☆34Oct 15, 2026Updated 2 weeks ago
- ☆13May 9, 2025Updated last year
- toy reproduction of Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts☆31Sep 1, 2024Updated 2 years ago
- ☆17Jun 15, 2026Updated 4 months ago
- Distillation pipeline from pretrained Transformers to customized FLA models☆13Aug 4, 2025Updated last year
- ☆15Jul 17, 2026Updated 3 months ago
- Post-Trained MoE Can Skip Half Experts via Self-Distillation☆42Sep 6, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆39Jan 16, 2025Updated last year
- Routing-aware expert paging for memory-constrained MoE serving — a vLLM plug-in with byte-identical outputs and joint expert/KV memory al…☆15Sep 15, 2026Updated last month
- [ICLR2025] Codebase for "ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing", built on Megatron-LM.☆123Dec 20, 2024Updated last year
- MobileNetV2: Inverted Residuals and Linear Bottlenecks☆10Jul 22, 2019Updated 7 years ago
- Official repository for the paper: "You Only Prune Once: Designing Calibration-Free Model Compression With Policy Learning" [ICLR 2025]☆10Apr 13, 2025Updated last year
- Agent application/benchmark/workload traces should be placed here.☆20Apr 13, 2026Updated 6 months ago
- Rad-cGAN v1.0: Radar-based precipitation nowcasting model with conditional Generative Adversarial Networks for multiple dam domains☆11Jul 22, 2022Updated 4 years ago
- The Newton-Muon optimizer☆35Jun 5, 2026Updated 4 months ago
- ☆32Jan 7, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆52Nov 19, 2025Updated 11 months ago
- Triton kernels for dynamic causal short convolutions.☆31Jun 4, 2026Updated 4 months ago
- ModSleuth builds evidence-grounded dependency graphs for LLM releases from public artifacts such as model cards, dataset cards, technical…☆17Jun 15, 2026Updated 4 months ago
- [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models☆165Jul 9, 2025Updated last year
- ☆17May 27, 2026Updated 5 months ago
- ☆13Jan 15, 2026Updated 9 months ago
- ☆38Apr 5, 2024Updated 2 years ago