some mixture of experts architecture implementations
☆27Mar 22, 2024Updated 2 years ago
Alternatives and similar repositories for MoE
Users that are interested in MoE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICCV 2025] FiVE-Bench: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Models☆19Aug 26, 2025Updated 9 months ago
- nanoGPT-like codebase for LLM training☆118Nov 7, 2025Updated 7 months ago
- ☆19Apr 16, 2025Updated last year
- Official respository for ECCV24 paper "Diffusion-Guided Weakly Supervised Semantic Segmentation"☆19Dec 17, 2024Updated last year
- a fast implementation of BM25☆10Sep 15, 2022Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Implementation of "Towards Understanding Mixture of Experts in Deep Learning", NeurIPS 2022☆10Jan 6, 2023Updated 3 years ago
- Reimplementation of https://github.com/montemac/algebraic_value_editing in pure PyTorch for efficiency on large models☆11Jun 28, 2023Updated 2 years ago
- An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.☆21Nov 28, 2022Updated 3 years ago
- PyTorch Code for the Paper: "Exploiting Uncertainty of Loss Landscape for Stochastic Optimization [Bhaskara et al. (2019)]☆16Apr 30, 2026Updated last month
- Machine learning project using federated learning for text generation☆11May 5, 2024Updated 2 years ago
- ☆19Jun 10, 2024Updated 2 years ago
- An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace☆19Oct 21, 2024Updated last year
- ☆14Aug 28, 2019Updated 6 years ago
- [ICLRW'26] EoRA: Fine-tuning-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation☆47Apr 21, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Federated Learning - PyTorch☆15Jun 27, 2021Updated 4 years ago
- A Rust library for creating solvers in the OP Stack's dispute protocol☆19Jan 15, 2024Updated 2 years ago
- Qwen3-0.6B megakernel: 527 tok/s decode on RTX 3090 (3.8x faster than PyTorch)☆110Feb 10, 2026Updated 4 months ago
- ☆22Jan 23, 2024Updated 2 years ago
- General Matrix Multiplication using NVIDIA Tensor Cores☆28Jan 25, 2025Updated last year
- Jax implementation of the AdaHessian optimizer☆19Mar 11, 2021Updated 5 years ago
- Manifold-Mixup implementation for fastai V1☆19Oct 1, 2020Updated 5 years ago
- Adversarial Erasing Framework via Triplet with Gated Pyramid Pooling Layer for Weakly Supervised Semantic Segmentation, ECCV2022☆31Jul 8, 2024Updated last year
- GitHub Action to automatically format Rust code and fix clippy lints.☆28Nov 24, 2025Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- PyTorch implementation of Mixer-nano (#parameters is 0.67M, originally Mixer-S/16 has 18M) with 90.83 % acc. on CIFAR-10. Training from s…☆38Nov 6, 2021Updated 4 years ago
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)☆29Mar 1, 2024Updated 2 years ago
- Federated learning using a mixture of experts☆17Feb 16, 2021Updated 5 years ago
- Official repository for CVPR 2023 paper: WSSS via Adversarial Learning of Classifier and Reconstructor☆29Jul 8, 2024Updated last year
- ☆17Dec 11, 2022Updated 3 years ago
- Deep Learning CNN using FastAI for the Stanford MRNet Knee MRI diagnosis challenge☆16May 18, 2019Updated 7 years ago
- Anima Machina☆45Updated this week
- Towards Understanding the Mixture-of-Experts Layer in Deep Learning☆35Dec 12, 2023Updated 2 years ago
- Subscriptions using Porto.☆28Jul 5, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The simplest, fastest repository for training/finetuning medium-sized GPTs with LoRA support.☆30Feb 19, 2024Updated 2 years ago
- Asynchronous P2P communication backend for decentralized pipeline parallelism☆44Updated this week
- [NeurIPS 2024] The official implementation of "Kangaroo: Lossless Self-Speculative Decoding for Accelerating LLMs via Double Early Exitin…☆69Jun 26, 2024Updated last year
- Unlocking the Potential of Ordinary Classifier: Class-specific Adversarial Erasing Framework for Weakly Supervised Semantic Segmentation,…☆41Oct 25, 2022Updated 3 years ago
- The official repo of continuous speculative decoding☆35Mar 28, 2025Updated last year
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆251Jun 15, 2025Updated last year
- No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models (ICLR 2022)☆29Feb 9, 2022Updated 4 years ago