Towards Understanding the Mixture-of-Experts Layer in Deep Learning
☆35Dec 12, 2023Updated 2 years ago
Alternatives and similar repositories for MoE
Users that are interested in MoE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2025] What Makes a Reward Model a Good Teacher? An Optimization Perspective☆43Sep 18, 2025Updated 6 months ago
- KDSS is the framework for knowledge distillation from LLMs☆12Nov 5, 2025Updated 4 months ago
- Code Repository for the NeurIPS 2024 Paper "Toward Efficient Inference for Mixture of Experts".☆19Oct 30, 2024Updated last year
- ICLR 2021 (spotlight): Graph Convolution with Low-rank Learnable Local Filters☆16Jan 14, 2021Updated 5 years ago
- Provably (and non-vacuously) bounding test error of deep neural networks under distribution shift with unlabeled test data.☆10Feb 27, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- ☆24Jul 16, 2025Updated 8 months ago
- ☆39Jun 14, 2025Updated 9 months ago
- The code will come soon.☆16Sep 12, 2025Updated 6 months ago
- ICLR 2022 (Spolight): Continual Learning With Filter Atom Swapping☆16Jul 5, 2023Updated 2 years ago
- [AAAI 2025] Trusted Unified Feature-Neighborhood Dynamics for Multi-View Classification☆19Apr 17, 2025Updated 11 months ago
- ☆12May 15, 2024Updated last year
- Federated Learning - PyTorch☆15Jun 27, 2021Updated 4 years ago
- The code of MetaViewer: Towards A Unified Multi-View Representation (CVPR 2023).☆10Nov 20, 2023Updated 2 years ago
- ☆17Oct 7, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- About PyTorch implementation for ‘’Robust Multi-View Clustering with Noisy Correspondence‘’ (TKDE 2024)☆11Aug 2, 2024Updated last year
- The official repos of "Rethinking Multi-view Representation Learning via Distilled Disentangling"☆12Apr 3, 2024Updated last year
- Code for MSH-Net: Modality-Shared Hallucination with Joint Adaptation Distillation for Remote Sensing Image Classification Using Missing …☆14Jan 17, 2024Updated 2 years ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆63Mar 11, 2025Updated last year
- Diffusion-based Missing-view Generation With the Application on Incomplete Multi-view Clustering☆10May 26, 2024Updated last year
- A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models☆848Sep 13, 2023Updated 2 years ago
- Official implementation of 'P$^2$OT: Progressive Partial Optimal Transport for Deep Imbalanced Clustering'. (Accepted by ICLR 2024)☆18Jan 19, 2024Updated 2 years ago
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)☆29Mar 1, 2024Updated 2 years ago
- Self-Weighted Contrastive Learning among Multiple Views for Mitigating Representation Degeneration☆11Oct 23, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Evaluation code for the PhysioNet Challenge 2024☆12Oct 17, 2025Updated 5 months ago
- This is code for “Upper Bounding Barlow Twins: A Novel Filter for Multi-relational Clustering” AAAI-24.☆12May 17, 2024Updated last year
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆20Oct 18, 2024Updated last year
- Single-Source Domain Generalization for Bearing Fault Diagnosis Using Feature-Augmented Adaptive Neuro-Fuzzy Inference System☆11Apr 13, 2024Updated last year
- ☆18Feb 7, 2026Updated last month
- Code for experiments on transformers using Markovian data.☆22Nov 22, 2024Updated last year
- Deep Double Incomplete Multi-view Multi-label Learning with Incomplete Labels and Missing Views☆13Apr 7, 2024Updated last year
- ☆11Mar 29, 2021Updated 5 years ago
- What Is a Good Caption? A Comprehensive Visual Caption Benchmark for Evaluating Both Correctness and Thoroughness☆26May 16, 2025Updated 10 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Official code for the paper Improving Language Plasticity via Pretraining with Active Forgetting, NeurIPS 2023☆21Mar 12, 2026Updated 2 weeks ago
- ☆20Apr 16, 2025Updated 11 months ago
- EMVCC:Enhanced Multi-View Contrastive Clustering for Hyperspectral Images☆12Mar 5, 2026Updated 3 weeks ago
- GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection☆22Mar 7, 2024Updated 2 years ago
- ☆18Jun 14, 2025Updated 9 months ago
- ☆20Mar 5, 2024Updated 2 years ago
- An open source and enterprise-grade implementation of the orchestrator-worker pattern from Anthropic's paper, "How we built our multi-age…☆25Oct 9, 2025Updated 5 months ago