Towards Understanding the Mixture-of-Experts Layer in Deep Learning
☆35Dec 12, 2023Updated 2 years ago
Alternatives and similar repositories for MoE
Users that are interested in MoE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Master Thesis Project☆17Jun 21, 2025Updated last year
- a fast implementation of BM25☆10Sep 15, 2022Updated 3 years ago
- Implementation of "Towards Understanding Mixture of Experts in Deep Learning", NeurIPS 2022☆10Jan 6, 2023Updated 3 years ago
- Reimplementation of https://github.com/montemac/algebraic_value_editing in pure PyTorch for efficiency on large models☆11Jun 28, 2023Updated 3 years ago
- Provably (and non-vacuously) bounding test error of deep neural networks under distribution shift with unlabeled test data.☆10Feb 27, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Code and Dataset for <Quantitative Analysis of Melodic Similarity in Music Copyright Infringement Cases, ISMIR 2024>☆15Nov 12, 2024Updated last year
- A variation on a standard Decision Tree such as that in sklearn, where nodes may be based on an aggregation of multiple splits.☆10May 24, 2024Updated 2 years ago
- Machine learning project using federated learning for text generation☆11May 5, 2024Updated 2 years ago
- [NeurIPS 2025] What Makes a Reward Model a Good Teacher? An Optimization Perspective☆44Sep 18, 2025Updated 10 months ago
- Python Version of Andrew Welter's Hatebase Wrapper☆10Feb 20, 2022Updated 4 years ago
- ICLR 2022 (Spolight): Continual Learning With Filter Atom Swapping☆16Jul 5, 2023Updated 3 years ago
- ☆19Jun 10, 2024Updated 2 years ago
- The code implementation of the <Achieving a Better Stability-Plasticity Trade-off via Auxiliary Networks in Continual Learning> in The Co…☆14May 25, 2023Updated 3 years ago
- This paper has been accepted by IEEE Transactions on Image Processing.☆10Feb 24, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- About PyTorch implementation for ‘’Robust Multi-View Clustering with Noisy Correspondence‘’ (TKDE 2024)☆11Aug 2, 2024Updated last year
- ☆17Feb 4, 2026Updated 5 months ago
- Diffusion-based Missing-view Generation With the Application on Incomplete Multi-view Clustering☆10May 26, 2024Updated 2 years ago
- ☆13Sep 1, 2023Updated 2 years ago
- ☆15Apr 13, 2025Updated last year
- This is code for “Upper Bounding Barlow Twins: A Novel Filter for Multi-relational Clustering” AAAI-24.☆12May 17, 2024Updated 2 years ago
- A demo code of "OTCE: A Transferability Metric for Cross-Domain Cross-Task Representations" published in CVPR2021☆18Jun 23, 2021Updated 5 years ago
- A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models☆866Sep 13, 2023Updated 2 years ago
- ☆14Jul 13, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Reference implementation of DecDTW in PyTorch (ICLR 2023)☆24May 29, 2023Updated 3 years ago
- Official implementation for SPA: A Graph Spectral Alignment Perspective for Domain Adaptation (NeurIPS 2023)☆18Dec 21, 2023Updated 2 years ago
- Evaluation code for the PhysioNet Challenge 2024☆12Oct 17, 2025Updated 9 months ago
- Code for paper "Network Bending of Diffusion Models for Audio-Visual Generation" at DAFx 2024☆17Aug 26, 2025Updated 11 months ago
- Code for the paper "Toward Fully Self-Supervised Multi-Pitch Estimation".☆25Sep 27, 2025Updated 10 months ago
- Self-Weighted Contrastive Learning among Multiple Views for Mitigating Representation Degeneration☆11Oct 23, 2023Updated 2 years ago
- ☆19Mar 25, 2025Updated last year
- Self-Supervised Generative Style Transfer for One-Shot Medical Image Segmentation☆29Oct 7, 2021Updated 4 years ago
- Federated learning using a mixture of experts☆17Feb 16, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- About the code release for "Federated PCA on Grassmann Manifold for IoT Anomaly Detection" ToN2024☆20May 28, 2025Updated last year
- Code for experiments on transformers using Markovian data.☆22Nov 22, 2024Updated last year
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)☆29Mar 1, 2024Updated 2 years ago
- CONditionals for Ordinal Regression and classification in PyTorch☆12Nov 5, 2022Updated 3 years ago
- Level Set Methods for image segmentation☆27Apr 24, 2014Updated 12 years ago
- Deep Double Incomplete Multi-view Multi-label Learning with Incomplete Labels and Missing Views☆14Apr 7, 2024Updated 2 years ago
- ☆13Nov 7, 2023Updated 2 years ago